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ABSTRACT 

A report on tests used by California undergraduate 
institutions and by graduate and professional schools is presented by 
the California Postsecondary Education Commission. Information is 
provided on five tests used by undergraduate colleges: the 
Preliminary Scholastic Aptitude Test/National Merit Scholarship 
Qualifying Test, the Scholastic Aptitude Test, College Board 
Achievement Tests, the American College Test, and the Test of English 
as a Foreign Language. Also covered are four tests used by graduate 
and professional schools: the Graduate Record Examinations, the 
Graduate Management Admission Test, the Law School Admission Test, 
and the Medical College Admission Test. In addition to describing the 
tests, information is included on: mean scores by ethnicity and sex, 
percentages of examinees achieving scaled score levels, and 
percentile rank ranges by subject area tested. For each test, 
information is provided by the testing agency on: the beginning and 
ending dates of the testing year, total times the test was taken 
during the testing year, and direct expenses for the testing program 
categorized by type of expense. The text of California Senate Bill 
1758 concerning postsecondary education and standardized tests is 
appended. (SW) 
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Summary 



Senate Bill 1758 (Torres, 1984) requires that spon- 
sors of standardized tests administered to 3,000 
students in California for college admission or 
placement purposes file with the California Post- 
secondary Education Commission a financial 
statement, copies of tests with answers, and data 
relative to tests administered nationally and in 
California. It also requires the Commission to sub- 
mit an annual report summarizing these test data 
to various State and institutional officials. 

This is the Commission's second report in this an- 
nual series. It covers the testing year 1985-86 - 
the first in which the law was fully operational - 
and contains brief summary stateirents about 
each of tho nip ^ tests that meet the requirements 
of the law. 

• Part Or e on pages 3-14 describes five tests used 
by imdergraduate colleges - the Preliminary 
Scholastic Aptitude Test/National Merit Schol- 
arship Qualifying Test, the Scholastic Aptitude 
Test, College Bo^rd Achievements Tests, the 
American College Test, and the Test of English 
as a Foreign Language. 

• Part Two on pages 15-18 describes four tests 
used by graduate and professional schools - the 
Graduate Record Examinations, the Graduate 
Management Admission Test, the Law School 
Admission '^est, and the Medical College Ad- 
mission Test. 

• Appendix B on pages 29-136 reproduces finan- 
cial disclosure data and additional information 
received by the Commission from the sponsors 
of the nine tests. 

The Commission adopted this report at its March 
16, 1987, meeting on the advice of its Policy Evalu- 
ation Committee. Additional copies of the report 
may be obtained from the Publications OfTice of 
the Commission. Further information about the 
report may be obtained from Horace F Crandell of 
the Commission staff at (916) 322-8002. 
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IN 1978, California became the first state to enact 
*'truth-in-testing," or ''test disclosure" legislation 
(Senate Bill 2005, Dunlap). That law required spon- 
sors of standardized admissions tests to file financial 
disclosure statements, copies of materials distribut- 
ed to test-takers, and copies of recent tests with cor- 
responding answers with the California Postsecond- 
ary Education Commission, provided that the test 
was administered to at least 3,000 individuals in 
California. This information then became public 
record, available to interested parties through the 
Commission's library. 

The ^ alifornia law, and proposals for similar legis- 
lation in over two dozen states and in Congress, was 
brought about as a result of heated debate between 
critics of testing on the one hand, who argued that 
admission tests discriminated against certain 
groups and that the rights of test takers were not 
adequately protected, and groups on the other hand 
that hailed the benefits of such tests and believed 
that the disclosure of tests to the public would not 
enhance public understanding of the role tests play- 
ed in the overall admission process and that govern- 
ment should not regulate inis process. The leading 
critics of testing and advocates of legislation to regu- 
late it were consumer-advocacy Public Interest Re- 
search Groups, with Ralph Nader as their national 
spokesperson. Opponents to such legislation includ- 
ed test sponsors such as the College Board, test de- 
velopers and administrators such as the Educational 
Testing Service, and leading educational associa- 
tions such as the American Council on Education 
and the American Association of Collegiate Regis- 
trars and Admissions Officers (Greer. 1984, p.322j. 

In 1979, New York became the first state to enact 
legislation requiring unlimited test disclosure and 
the return of tests and answers to test-takers. New 
York's law, which also provided procedures by which 
test-takers could challenge test answers and the 
score they received on the tests, became the model 
law on which other states and Congress based their 
proposals. So far, however, California has been the 
only other state to enact similar consumer protection 
- Senate Bill 1758 (Torres, 1984), which is repro- 
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duced in A*ppendix A. This report responds to that 
law. 

Sections ^9152-99154 of the California Education 
Code, created by that law, require that sponsors of 
standardized tests used fcr admission or placement 
of students in California colleges file a financial 
statement, copies of tests with answers, and data 
relative to tests administered nationally and in 
California. Section 99155 of the Code requires the 
California Postsecondary Education Commission to 
submit an annual report summarizing these test da- 
ta to the Crovernor, the Legislature, the Regents of 
the University of California, the Board of Governors 
of the California Community Colleges, the Trustees 
of the California State University, and the Super- 
intendent of Public Instruction. In addition, the 
Commission is to maintain materials submitted by 
the test sponsors and make them accessible to the 
public. 

The testing year 1985-86 was the first in which the 
law was fully operational Each of the test sponsors 
has complied with the test disclosure and consumer 
protection provisions of the law, although several of 
them are still in the process of developing computer 
programs to obtain and report California test-score 
data by sex and ethnicity. The data that are 
currently available have been included in this 
report, and as the Commission receives additional 
data, they will be entered into the Commission's da- 
ta base and -eferenced in future reports. 

This report contains brief summary statements 
about each of the tests for which the Commission has 
received information - in Part One, those used by 
undergraduate institutions, and in Part Two, those 
used by graduate and professional schools. 

• Part One describes five tests for undergraduate 
colleges - the Preliminary Scholastic Aptitude 
Test/National Merit Scholarship Qualifying Test, 
the Scholastic Aptitude Tests, College Board 
Achievements Tests, the American College Test, 
and the Test of English as a Foreign Lang'jage 

• Part Two describes four tests for graduate and 
professional schools - the Graduate Record Ex- 
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aminations, the Graduate Management Admis- 
sion Test, the Law School Admission Test, and 
the Medical College Admission Test. 

Financial disclosure data and additional informa- 
tion pertaining to the tests are reproduced from the 
test sponsors in Appendix B. 

Because standardized tests play a major role in col- 
lege admission and placement, it is important that 
studentb, parents, educators, and the general public 
understand the purposes and characteristics of these 
tests and the uses of test scores. To this end, the 
sponsors of all tests summarized in this report pro- 



vide high school and college counseling offices with 
information about their tests, including their statis- 
tical reliability and usefulness in predicting first 
year academic success. They also provide potential 
test takers with information bulletins describing the 
tests and containing sample questions from past edi- 
tions of the tests. These pamphlets, brochures, 
books, and tests may be reviewed in the Commis- 
sion's library at 1020 Twelfth Street, Sacramento, 
California 95814. Information about library hours 
may be obtained from Elizabeth Testa, Senior Li- 
brarian, at (916) 322-8031 



9 



1 



Tests Used for College Admission, 
Placement, and Financial Awards 



Preliminary Scholastic Aptitude Test/ 
National Merit Scholarship Qualifying 
Test (PSAT/NMSQT) 

The Preliminary Scholastic Aptitude Test/National 
Merit Scholarship Qualifying Test (PSAT/NMSQT) is 
intended to measure the verbal and mathematical 
reasoning ability of high school juniors rather than 
their knowledge in specific academic areas. In 1985, 
it was taken by 1,181,571 juniors, including 99.499 
Califomians - an increase over the previous year of 
42,000 nationally and 4,10G in California. 

High school juniors may take the test for several rea- 
sons. As its name implies, it serves as a "warm-up" 
for taking the Scholastic Aptitude Test (SAT) in the 
senior year. It also serves as the basis for recogni- 
tion and scholarships offered in the National Merit 
Scholarship Program, the National Achievement 
Scholarship Program for Outstanding Negro Stu- 
dents, the National Hispanic Scholar Awards Pro- 
gram, and the Telluride Association Summer Pro- 
gram in the humanities and social sciences. 

Following the correction of their tests, students re- 



ceive a copy of the test book, a list of the correct an- 
swers, their own answers, their scores, and their per- 
centile rank. This affords them the opportunity to 
check their errors, compare themselves with other 
test-takers nationally, and sense how they might 
score on the SAT. Students and their counselors may 
also determine areas where academic skills and pre- 
paration could be strengthened. 

Display 1 below shows the ethnic composition of test- 
takers nationally and in California. As might be ex- 
pected, the proportion of Asian-American and Mexi- 
can-American students among the test-takers is 
much greater in California than in the nation at 
large, while the proportion of whites is lower. 

Display 2 on page 4 compares national and Califor- 
nia mean verbal and mathematics scores as well as 
California scores by ethnicity and sex. National and 
California mean verbal scores remained virtually 
unchanged between 1984 and 1985, with California, 
at 40.5 on a scale of 20 to 80, remaining slightly be- 
low the national mean of 40.9. Mean mathematics 
scores, however, increased from 44.2 to 45.0 nation- 
ally and from 44.6 to 45.3 in California. This in- 



DISPLAY 1 Ethnic Background of High School Juniors Taking the PSATiNMSQT in 1985 





National 


California 


CaURory 


Number 


Percent 


.Number 


Percent 


American Indian 


5.146 


0.5% 


694 


0 8% 


Asian American 


44.! 11 


4.1 


14.244 


15 4 


Black 


78.542 


73 


5,287 


57 


Mexican American 


23.111 


2.1 


8.928 


97 


Puerto Rican 


9.016 


0.8 


224 


0 2 


Other Hispanic 


15.682 


1.4 


3,005 


33 


White 


897.878 


82.9 


58,354 


63 1 


Other 


9.382 


09 


1,681 


1 8 


No Response 


98,703 




7,082 





Source: College Entrance Examination Board, 1986'-. 
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DISPLAY 2 Mean Scores of California Juniors, by Ethnicity and Sex. taking the PSaT/SMSQT in 1985 



VERBAL MATHEMATICS 





ToUl 


Men 




Women 


Total 




Mfn 


Women 


Cttecorr 




Mmb 






Number 


Mtac 


Number 


Mt«n 


Numb«r 


Mt»a 


Numbfr 


M<ao 


American Inditn 


694 


38.8 


313 


39.0 


379 


38.8 


694 


42.2 


313 


44.3 


379 


40.5 


Astaa American 


14^43 


38.5 


6.890 


39.0 


7.340 


38.1 


14,244 


48.7 


6.890 


51.1 


7,341 


46.6 


Black 


5^86 


34.2 


2.030 


34.8 


3^49 


33.9 


5,287 


36.9 


2.031 


38.2 


3.249 


36.0 


Bfaxicaa-Amtrican 


8.927 


35.1 


3.885 


35.8 


5,021 


34.6 


8324 


38.8 


3.885 


40.8 


5.018 


37.3 


Putrto Rkan 


224 


37.5 


100 


38.2 


124 


36.9 


224 


39.8 


100 


41.5 


124 


38.4 


OtfatrHia|»nic 


3.004 


36.2 


1.324 


37.2 


1,674 


35.4 


3.004 


39.8 


1.325 


42.4 


1.673 


37.8 


White 


58.3S3 


42.7 


26..496 


43.4 


31.808 


42.3 


58.338 


46.8 


26.489 


49.1 


31.800 


44.8 


Othtr 


1.680 


38.3 


777 


40.1 


901 


36.8 


1.680 


42.7 


778 


45.5 


900 


40.3 


NoRaaponse 


7.082 
























California 


90.499 


40.5 


45^75 


41.2 


54.108 


40.0 


99.499 


45.3 


45.275 


47 7 


54.108 


43.3 


National 1, 


181.571 


40.9 


537.170 


41.5 


643.375 


40.3 


1.181.571 


45.0 


537.170 


47.3 


643,375 


43.2 



Source: College Entrance Exammation Board. I986e. pp. 4 and 6-9. and unpublished reports. 



creaae was particularly interesting because of the 
increased number of students taking the test in 
1985. With increased numbers, mean scores have 
ordinarily declinec! as more students from diverse 
backgrounds have participated. 

As was true in prior years, males who took the PSAT- 
NMSQT in 1985 scored higher than women on both its 
verbal and mathematics portions, nationally as well 
as in California. Considerable difierences in scores 
occurred among ethnic groups in California, with 
white students averaging 42.7 on the verbal test, 
compared to 34.2 for Black students. On the mathe- 
matics test, Asian-American students had the high- 
est average score - 48.7, compared to 46.8 for white 
students and 36.9 for Black students. 

Although Displays 1 and 2 report scaled mean scores 
in tenths of points, the scores of individual students 
are rounded prior to being reported to them; and be- 
cause no test can measure ability perfectly, the Col- 
lege Board encourages students and counselors to 
view scores in a range rather than as precise points 
on a scale. In the case of the PSAT/NMSQT, this range, 
or '^standard error of measurement," is four points. 
Hence a reported score of 40 should be thought of as 
a true score of somewhere between 36 and 44. Small 
differences in reported scores, therefore, may not in- 
dicate any real differences in the ability of students 



Scholastic Aptitude and 

Coh*ege Board Achievement Tests 

The Scholastic Aptitude Test (SAT) and the College 
Board Achievement Tests are part of the College 
Board Admissions Testing Progrr.m, which also in- 
cludes the Test of Standard Written English and the 
Student Descriptive Questionnaire. 

• The SAT is a two-and-one-half hour multiple- 
choice test that measures verbal and mathema- 
tical reasoning abilities related to academic suc- 
cess in college. It serves as a national common 
standard of measurement for colleges in compen- 
sating for the wide variety of high school course 
content and grading standards throughout the na- 
tion. 

• The College Board Achievement Tests measure 
knowledge in specific subject areas and are re- 
quired of students by some colleges for admission, 
placement, or both. 

• The Test of Standard Written English is a 30-min- 
ute multiple choice test adminstered with the SAT 
that can be used by colleges for placement of stu- 
dents in freshman English classes. 

• The Student Descriptive Questionnaire is com- 
pleted by students taking either the SAT or the 
Achievement Tests and provides colleges with ed- 
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*icational and extracurricular information about 
them. 

Scholastic Aptitude Test 

"No psychometric instrument has received more me- 
dia scrutiny and discussion or generated more con- 
troversy than the Scholastic Aptitude Test,** Lloyd 
Bond has written in his '^In Defense of Admissions 
Testing^ (1986). The remarkable feature of the con- 
troversy is the persistently contradictory nature of 
the arguments: It has been claimed at one time or 
another in the course of the debate that the SAT is 
overused, and that it is underused; that it is relative- 
ly insensitive to special preparation, and that it is 
very sensitive to such ^ 'eparation; that it advances 
the cause of equity and access, and that it frustrates 
those goals; that it is ^ne of the best predictors of col- 
lege performance, and that it is next to useless in 
making such predictions. The list goes on and on.** 

Bond's comments summarize more than a decade of 
published books and articles about the SAT and serve 
to highlight not only an ongoing controversy regard- 
ing it but also its significance in the minds of many 
people, including publishers. Yet the College Board 
and the Educational Testing Service - the SAT's 
sponsor and creator - constantly remind the public 
that the it should not be considered the pivotal point 
around which a student's future career is thought to 
resolve. As Gregory Anrig, president of the Educa- 
tional Testing Service since 1981, has commented, **I 
urge people not to put too much weight on tests, to 



realize that they provide useful - but limited - infor- 
mation" (1986). And Warren Willingham of the Col- 
lege Board has shown that persistent and successful 
extracurricular accomplishment in high school is a 
better predictor of leadership in college than high 
school grades or high SAT scores (1985, p. 179). Thus, 
most prestigious colleges and universities use many 
ether factors besides the SAT in making their admis- 
sions decisions. However, the SAT remains an impor- 
tant part of their overall evaluation, since, when 
considered along with high school grades, it remains 
the best measure for predicting first-year grades in 
college and, when combined with Achievement Test 
scores, the best predictor of success in college majors. 
Over a million high school students took the test in 
1985 - two out of every three going on to college - 
and of the million, 108,287 were in California. 

Both the University of CalL^ornia and the California 
State Universit ' use total SAT scores, combined with 
high school grade-point averages (GPA), as a facte r in 
making admissions decisions. They use the combi- 
nation of scores and grades to produce an "Eligibili- 
ty Index** for admission. If students' grade-point av- 
erages are low, their combined verbal and mathe- 
matics scores on the SAT must be correspondingly 
higher - and vise versa, as Display 3 below shows. 
That display also indicate*: that University of Cali- 
fornia applicants with a grade-point average above 
3.30 need take the SAT for placement only and that 
State University applicants with a grade-point aver- 
ag2 above 3.10 need not take the SATat all 



DISPLAY 3 Abbreviated Eligibility Indexes of the University of California and the C difornia State 
University, Using the Scholastic Aptitude Test (SAT), 1987-1988 



Grade-Pou-^.t 
Average (CPA) 



3.30 
3.10 
2.80 
2.40 
2.00 



Minimum Sicholastic .Aptitude Test (Sat) Score 



University of California 

If GPA is above 3.30, SAT is 
used oniy for placement purposes 
400 
850 
1550 

CPA below 2.78 does not qualify. 



The California State University 



If GPA is above 3 10, SAT is not required. 

520 

760 
1080 
1400 

GPA below 2.00 does not qualify. 
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Display 4 on page 7 shows the mean verbal and 
mathematics scores of SAT test takers nationally and 
in California over the past five years, reported on 
scales from 200 to 800. As can be seen, mean verbal 
scores nationally and in California were nearly 
equal in 1981-82, but by 1985-86, California scored 8 
points below the national mean of 431 on a scale of 
200 to 800. On the mathematics test, however, Cali- 
fornia's mean score continued to surpass the nation- 
al mean throughout the period and in 1985-86 ex- 
ceeded the national mean by 6 points. 

Display 5 on page 8 reports five years of SAT mean 
scores by sex, nationally and in California. At the 
national level as well as in California, men contin- 
ued to score higher than women in 1985-86 on both 
the verbal and mathematics tests. On the verbal 
test, the mean scores of both California men and 
women declined, however, while the national mean 
for men remained constant from the previous years 
and that of women improved. On that test, the gap 
between high national mean scores and low Califor- 
nia scores has continued to increase over the past 
five years. In contrast, on the mathematics test, 
California men and women have both continued to 
surpass their national counterparts. On that test, 
the scores of California women remained constant in 
1985-86, however, while those for California men in- 
creased by two points. 

College Board Achievement Tests 

College Board Achievement Tests are offered in 14 
subject areas, with each test lasting one hour. Dis- 
play 6 compares national and California mean 
scores, on a range of 200 to 800, for the three of the 
14 taken most frequently by Californians. It shows 
that in 1985-86 as in 1984-85, Californians earned 
lower mean scores in each subject area than their 
national counterparts, but both national and Cali- 
fornia means improved over the 1984-85. 

Applicants to the University of California must take 
three College Board Achievement Tests, including 
English Composition, Mathematics I or II, and one 
test from English literature, foreign language, sci- 
ence, or social studies. Applicants to the California 
State University do not need to take any of the 
Achievement Tests, although they may use them for 
placement purposes. 



American College Test 

Of the national high school graduating class of 1986, 
729,606 had taken the ACT Assessment, primarily 
students in the mid-west, rocky mountains and 
plains, and the south. Californians were only 
11,377 of the national total. The ACT, however, is an 
alternate examination to the SAT. for admission to 
both the University of California and the California 
State University. The "eligibility index" using the 
ACT appears in Display 7. 

1 i four-part ACT is curriculum based, i.e., it tests a 
students content-specific knowledge and skills, ob- 
tained and developed over three or four years of high 
school, in English, mathematics, social studies, and 
natural science. A sound academic preparation is a 
prerequisite for doing well on the ACT, Each of the 
four tests produces a raw score which is converted to 
a standard score of 1 to 36. The composite score used 
by the University and State Unviersity in their eligi- 
bility index is simply the sum of these four standard 
scores, divided by four. 

California students do well in composite mean 
scores, compared to their mid-western counterparts, 
as seen in Display 8. The natural science test, con- 
taining 52 questions to be answered in 35 minutes, 
and covering the subject areas of biology, chemistry, 
physics, and physical sciences, is the only section of 
the ACT in which California nudents' scores dipped 
close to national means. 

In 1985-86, test takers in California, as well as the 
rest of the nation, improved their composite mean 
scores, and, as with the SAT, males, nationally, as 
well as in California, continued to surpass females, 
as is shown in Dispaly 9. However, for the first time 
in five years, while national scores for males and fe- 
males improved, as did scores for California females, 
the composite mean score for California males de- 
clined. Interestingly, the subject area of greatest de- 
cline for California males, natural science, was an 
area of mean score increase for California and na- 
tionally. 

Among ethnic groups, each improved their ACT com- 
posite mean score in 1985-86, led by Hispanics, at 0.6 
measurement units. The highest compoite means 
continued to be achieved by whites, at 19.7, and 
Asians, at 19.6, while the lowest was of Blacks, at 
13.0 A similar pattern of increased scores occurred 



ERLC 



DISPLAY 4 National and California Scholastic Aptitude Test Mean Scores, 1981-82 Through 1985-86 
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DISPLAY 5 National and California Scholastic Aptitude Test Mean Scores, 1981-82 Through 1985-86, 
by Sex 
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DISPLAY 6 National and California Mean Achievement Test Scores in English Composition, 
Mathematics Level I, and Mathematics Level II: 1985-1986 



English Composition 
Number Mean 



Mathematics I 
Number Mean 



National 
California 



192,498 
39,563 



522 
496 



149,562 
32,087 
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Mathematics II 
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50,261 
10.079 
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646 



Source: College Entrance Examinations Board, 1986e, p. 6; 1986f., p. 3. 



DISPLAY 7 Abbreviated Eligibility Index Using the American College Test (ACT): University of California, 
California State University, 1987-1988 



Grade Point Minimum ACT Score 

Average University of California Cahfornia State University 

3.30 5 Above 3.10 CPA qualifies without ACT 

3.10 18 11 

2.80 34 17 

2.40 Below 2.78 CPA does not qualify 25 

200 33 



Source: California Postsecondary Education Commission. 



in California, with mean scores of whites at 20.5, 
Asians at 19.8, and Blacks at 14.1. 

Advanced Placement Examinations 

About 30 percent of the high schools in the nation 
offer college level classes to their students. The cur- 
ricular material are provided to the high schools by 
the College Board, and final examinations in each 
subject area are designated and administered by the 
Educational Testing Service. Twenty-four Ad- 
vanced Placement Examinations are offered, in 13 
subject areas, each yielding a score of 1 (no recom- 
mendation) to 5 (extremely well qualified). More 
than a thousand colleges award either academic 
credit, advanced placement, or course waivers to stu- 
dents receiving a grade of 3 or better on an exam. 

In 1986, 228,606 students took Advanced Placement 
Examinations, including 37,378 from California. 
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Displays 10 and 11 compare national and California 
test takers by ethnicity on each of the subject matter 
examinations. 

Four of the examinations were taken by at least 
25,000 candidates nationally, and by more than 
3,400 students in California. American History, Bio- 
logy, English Literature and Composition, and 
Mathematics: Calculus AB. In each examination, 
mean scores received by California students exceed- 
ed rational mean scores The differe: es were most 
notable in Biology and in Mathematics. 

Nationally, among Blacks, Chicano/Mexican Ameri- 
cans, Asian Americans, and whites in 1986, Blacks 
achieved lower mean scores in each of the four major 
examinations, while Asian Americans received the 
highest mean scores. Of the four ethnic groups, only 
Asian Ar.iericans had mean scores greater than na- 
tional means in each of the four examinations men- 
tioned. 

J6 
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DISPLAY 8 National and California American College Test Composite Score MeanSy 
1981-82 Through 1985-86 




In California, however, while Blacks also received 
the lowest mean scores, whites achieved the highest 
mean scores in American History and in English 
Literature and Composition, while Asian Americans 
received higher mean scores in Biology and in Math- 
ematics. 



Test of English as a Foreign Language 

The major purpose of the Test of English as a For- 
eign Language (TOEFL) is to evaluate the English 
proficiency of people whose native language is not 
English. The test consists of three sections: Listen- 
ing Comprehension - Measures ability to understand 
spoken English; Structure and Written Expression - 
Measures ability to recognize language that is ap- 
propriate for standard written English; and Vocabu- 



lary and Reading Comprehension - Measures ability 
to understand nontechnical reading matter. More 
than 2,300 colleges in the United States and Canada, 
as well as in other countries where English is the 
language of instruction, require the test of both un- 
dergraduate and graduate applicants for whom 
English is not their native language. Last year over 
398,000 people registered to take the test. Educa- 
tional Testing Service administers the test, in coop- 
eration with the College Board and the Graduate 
Record Examinations, under three separate pro- 
grams - International, Special Center, and Institu- 
tional Programs. At both International and Special 
Centers, TOEFL is administered one day each month. 
These tests are then returned to ETS for scoring. 
Under the Institutional Testing Program, colleges 
throughout the world administer the test to their 
own students at their own convenience. In this pro- 
gram, ETS will score the tests, but it does not release 



DISPLAY 9 National and California American College Test Composite Score Means, 
mi '82 Through 1985-86, by Sex 




Source: American College Testing Program. 



the scores either to students directly or to other than 
the administering institution. Under this program, 
institutions have the option of scoring their own 
tests, and in such cases, do not report scores to ETS; 
and registration records of test takers are retained 
by the institutions and are not submitted to ETS. 

National and California average test scores are not 
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available for TOEFL, nor are other data available for 
either the number of tests administered in Caliior- 
nia or the number of test takers requesting that 
their scores be sent to California institutions. What 
information exists in the TOEFL Programs report pre- 
pared for the Commission appears in Appendix B to 
this report. 
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DISPLAY 11 Advanced Placement Program, California: All Candidates by Ethnicity, May 1986 
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Tests Used by Graduate and Professional Schools 



Graduate Record Examinations 

The Graduate Record Examinations consist of a 
General Test and seventeen Subject Tests used by 
graduate schools and departments for admissions, 
placement, and fellowships, and by fellowship 
donors for appraisals of prospective recipients of 
their awards. In the 1985-86 testing year, 264,949 
registrants took GREs, including 25,362 from Cali* 
fomia. National and California average test scores, 
however, are not gathered by the Educational Test- 
ing Service, administrator of the tests. 



Graduate Management Admission Test 

The Graduate Management Admission Test (GMAT) 
scores are one element used in evaluating candi- 
dates for admission to advanced study in business 
and management, and in predicting academic suc- 
cess in the first year of graduate school The GMAT 
measures general verbal and mathematical skills, 
rather than specific subject matter knowledge learn- 
ed as an undergraduate. GMAT scores are used by 
more than 800 graduate management programs 
throughout the world. During the 1985-86 testing 
>ear, 200,427 individuals sat for the 4-hour test, in- 
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eluding 16,060 from California. The national mean 
test score was 485; the State mean was 497. 

Educational Testing Services (ETS), which adminis- 
ters the GMAT for the Graduate Management Admis- 
sion Council, in analyzing past answer sheets of test- 
takers, concluded that a mfiyor probhm for students 
was their failure to read, or follow, instructions. To 
counter that tendency, the Council, in their Bulletin 
of Information, repeatedly emphasizes to registrants 
the need to read the directions carefully. Sample 
questions are also provided with each set of direc- 
tions, along with an answer key. A more helpful 
publication. The Official Guide to GMAT, published 
by f:ts, in addition to providing helpful information 
on test-taking, and a quick math review, contains 
three recent GMATs, with answers, for practice. 

A number of validity studies of the GMAT have been 
conducted and published since 1955, the most recent 
being GMAC Validity Study Servir^: A Three-Year 
Summary (Wightman and Leary, 1985). The results 
of studies published since 1972 are summarized in 
Graduate Management Admisston Test: Technical 
Report on Test Development and Score Interpretation 
for GMAT Users (Hecht and Schrader, 1986). Al- 
though 590 was the mean GMAT-Total score for ex- 
aminees in 1954, on a scale of 200-800, the mean for 
recent test takers was 478. Throughout the period 
studied, however, the GM^T has maintained a high 
reliability coefTicient among different forms of the 
test, and the standard error of measurement, which 
provides some idea of how much variation in ob- 
served scores might be expected if a test taker took 
several forms of the test, have been consistently at 
26-27. Thus, if a student has a reported score of 500, 
it is estimated that that score would be ±26 or +^27 
in two-thirds of repetitions of the test that student 
might take. Test score users are urged, therefore, to 
look at this range of scores, rather than a specific 
number, in comparing students' scores. Also, 
throughout the period from 1954, a combination of 
GMAT - Total scores with undergraduate GPAs - has 
had a significantly higher correlation with first-year 
grades than have undergraduate GPAs alone. 



The GRE General Test is designed to measure verbal, 
quantitative, and analytical ability, through seven 
30-minute test sections. The Subject Tests are de- 
signed to measure subject matter knowledge and un- 
derstanding acquired in an undergraduate mcgor, 
and considered basic to graduate study in that msg- 
or. Each Subject Test takes 2 hours and 50 minutes. 

In the Guide to the Use of the Graduate Record Ex- 
aminations Program: 1985-86, statistical inter- 
pretation of scores for the 1981-1984 period indicate 
that the General Test scores are useful, when consid- 
ered in addition to undergraduate grade point aver- 
ages, in determining the admissibility of a candidate 
to graduate school. When predicting academic suc- 
cess in the graduate major, however, scores on the 
Subject Tests are more valid than are undergraduate 
GPAs. 



Law School Admission Test(LSAT) 

The Law School Admission Test (LSAT) is used by all 
accredited and most nonaccredited law schools 
acs^oss the nation as one factor in determining the 
admissibility of students. During the 1985-86 test- 
ing year, 81,810 people took the test at least once, in- 
cluding 8,087 California residents: 4,591 males, and 
3,496 females. The national average test scores was 
30; the State average, 32. 

The LSAT consists of six 35-minute multiple-choice 
reading comprehension sections, and a 30-minute 
writing sample section. Two of the multiple-choice 
sections are considered pre-test, and are not scored. 
The writing sample also is not scored, but is submit- 
ted to law schools for their uhe in reaching decisions 
concerning admission. Since the new version of the 
test was inaugurated in June 1982, scores on the 
combination of four multiple-choice sections are re- 
ported on a scale of 10 to 48. The four different types 
of reading sections used in the test are intended to 
evaluate reading, understanding, and analyzing 
skills of prospective law students and are based on a 
broad range of academic disciplines, thereby giving 
no advantage to candidates from a particular acad- 
emic background 

As is the case with other test sponsors, there is a 
booklet containing sample test questions provided to 
each registrant for the LSAT. An additional helpful 
element, however, is that the booklet not only ex- 
plains each type of question, but offers a suggested 
approach to addressing the question. To further pre- 
pare for the actual half-day testing session, regis- 
trants are advised to take the four 35-minute prac- 
tice tests in one sitting, without taking a break, tim- 
ing themselves to exactly 35 minutes on each sec- 
tion, and otherwise simulate the actual testing envi- 
ronment as much as possible. 

The **new" LSAT has not been administered a suffi- 
cient number of times to provide for adequate statis- 
tical analysis of reliability and predictability nation- 
ally. However, individual law schools have worked 
with the Law School Admission Services to analyze 
their own students' scores and first-year grades 
Based on these preliminary analyses, the correlation 
between combined undergraduate CPA and LSAT, 



and first-year law school grades, is greater than 
either undergraduate CPAs, or LSAT scores alone. 



Medical College Admission Test (MC AT) 

The scores received by those taking the Medical Col- 
lege Admission Test are only one factor, but an im- 
portant one, used by medical schools in determining 
admissibility of students. Other factors usually con- 
sidered by admissions committees are undergradu- 
ate grades, the undergraduate courses taken by ap- 
plicants, the college attended, and the recommenda 
tion of the applicant's health profession advisor. 
Each admissions committee looks for candidates who 
would benefit most from the type of medical educa 
tion offered at their particular school. High mean 
scores on each of the six parts of the MCAT, therefore, 
do not necessarily guarantee an applicant considera- 
tion for admission. The Association of American 
Medical Colleges emphasizes this to test takers and 
encourages them to attempt to match their own pro- 
file with that of the appropriable medical schools. 

In addition to the six tests which have been the MCAT 
since IP" a seventh test was added as a pilot proj- 
ect sta^ang in 1985 • an essay The purpose of the 
essay is to measure the communications skills of the 
applicant. This pilot project is currently being eval- 
uated by a committee of the AAMC to determine the 
desirability as well as feasibilit> of including an 
essay question as a permanent part of the MCAT 

During the 1985-86 testing year, 40,881 tests were 
administered, including 3,807 to Californians. Dis 
plays 12 and 13 on pages 17 and 18 contain national 
and California mean scores for the April 1986 ad 
ministration of the MCAT Test scores are reported on 
a scale of 1 to 15. As will be noted., California resi- 
dents had mean scores in each test area considerably 
above those of test-takers nationally Comparable 
data by sex and ethnicity are not available. 

Scores on the MCAT subtests have high validity in 
predicting first-year grades in medical school. How- 
ever, the undergraduate Gpa/MCAT composite is a 
better predictor than either the CPA or the MCAT 
scores alone. 
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DISPLAY 12 Percentages of National MCAT Examinees Achieving Scaled Score Levels and Associated Percentile Rank Ranges by Area of 
Assessment, April 1986 Administration (N^ 18,690) 
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DISFLAY 13 Percentcjes of California MCAT Examinees Achieving Scaled Score Levels and Associated Percentile Rank Ranges by Area of 
Assessment, April 1986 Administration (N = U690) 
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APtjJNDIX A: Senate Bill No. 1758 



Senate BUI No. 1758 



CHAPTER 1505 

An act to repeal and add Chapter 3 (commencing with Section 
99150) to Part 65 of the Education Code, relating to-education. 

(Approved by Gpvemor September 27, 1984. Filed with 
SecreUry of State ^ptember 28, 1984.] 

LEGISLATIVE COUNSEL'S DIGEST 
SB 1758, Torres. Postsecondary education: standardized tests. 
Existing law requires any entity which sponsors a standardized test 
to report certain data» including financial disclosures, to the 
California Postsecondary Education Conmiission, and to provide 
specified information to test subjects' prior to the administration of 
a test 

This bill would repeal and recast existing law and would expand 
the type of information which a test agency or test sponsor, as 
defined, must submit to the commission. The bill would ako expand 
the information which must be provided to test subjects and would 
require each test agency to prepare clear, easily understandable 
written descriptions of each standardized test it administers, as 
si>ecified. 

The bill would also require a test agency to review and decide 
cases of suspec ^d test score inauthenticity or irregularity according 
to a specified procedure, based upon the substantial evidence 
standard. 

This bill would also prohibit the release or disclosure of aiiy test 
score identifiable with an individual test subject, as defined, except 
as specified. 

The people of the State of California do enact as follows: 

SECTION 1. Chapter 3 (commencing with Section 99150) of Part 
65 of the Exiucation Code is repealed. 

SEC. 2. Chapter 3 (commencing with Section 99150) is added to 
Part 65 of the Education Code, to read: 

Chapter 3. Standardized Tests 

99150. (a) The Legislature finds and declares that: 

(1) Education is fundamental to the development of all residents 
and to the progress of the state as a whole. 

(2) Standardized tests are a major factor in the admission and 
placement of students in postsecondary education. 

(3) There is increasing concern among residents, educators, and 
public officials regarding the proper uses of standardized tests in che 



29 



Ch. 1505 



— 2 — 



admissions and placement decisions of postsecondary education 
institutions. 

(4) The rights of test subjects should be assured without infringing 
upon the proprietary rights of the test agencies. 

(b) It is the inteut and purpose of the Legislature in enacting this 
chapter to do all d* the following: . 

(1) Ensure that test subjects and persons who use test results are 
fully aware of the characteristics, uses, and limitations of 
standardized test^ used in postsecondary education admissions and 
placement 

(2) Ensure due process protection of test subjects whose scores 
are being questioned for suspected inauthenticity or irregularity in 
test administration. 

(3) Provide test subjects with the opportunity to review the basis 
on which the test subject has been scored. 

(4) Make available to the public appropriate information 
regarding the procedure, development and administration of 
standardized tests. 

(5) Promote ipore knowledge about the proper use of 
standardized test results and promote greater accuracy, validity, and 
reliability in the development, administration, and interpretation of 
standardized tests. 

9915L (a) ''Admissions data assembly service" means any 
simfimary or report of grades, grade point averages, standardized test 
scores, or any combination of grades and test scores, of a test subject 
used by any test score recipient. 

(b) "Commission" means the California Postsecondary Education 
Commission. 

(c) "Standardized test" or "test" means any test administered in 
California at the expense of the test subject which is used for the 
purposes of admission to, or class placement in, postsecondary 
educational institutions or their programs, or any test used for 
preliminary preparation for those tests. 

"Standardized test" or "test" includes, but is not limited to, the 
Preliminary Scholastic Aptitude Test, the Scholastic Aptitude Test, 
the College Board Achievement Tests and Advanced Placement 
Tests, the ACT Assessment, the Graduate Record Examination, the 
Medical College Admission Te t, the Law School Admission Test, the 
Dental Admission Testing Program, the Graduate Management 
Admission Test, and the Miller Analogies Test. 

The standardized test does not include a test, or part of a test, 
which has been in use for less than Bve years, or which is 
administered to a selected group of individuals principally for 
research, pre-test, equating, guidance, counseling, or for the 
purposes of meeting graduation requirements of secondary schools 
and postsecondary educational institutions. 

Tests which are administered as supplements or auxiliaries to 
another test, or which form a specialized component of a test, may 



2 er|c 



30 



— 3 — 



Ch. 1505 



be combined for the purposes of this chapter. 

(d) "Secure test** means any test which contains items not 
available to the public and which, to allow the further use of test 
items and to protect the validity and reliability of the test, is subject 
to qiecial security procedures in its publication, distribution, and 
adndnistration. 

(e) *Test subject** or ''subject*' means an individual who takes a 
standardized test. 

(f) Test sponsor" or "test agency'* means an individual, 
partnenhip, corporation, association, company, firm, institution, 
society, trust; or joint stock company which develops, sponsors, or 
administers standardized tests. 

(g) "Testing year** means the 12 calendar months which the lest 
agency considers either its operational cycle or its fiscal year. 

(h) Test score** or "score** means the value given to the test 
8ubject*s performance on a standardized test, administered by the 
test agency, whether reported in numerical, percentile, or any other 
form. 

(i) Test score recipient** means any |)erson, organization, 
association, corporation, postsecondary education institution, or 
governmental agency or subdivision to which the test subject 
• requests or designates that a test agency report a test score. 

0) "Score reporting service" means the reporting of a test 
subject*s standardized score to a test score recipient by a test agency. 

(k) Test preparation course** means any curriculum, course of 
study, plan of instruction, or method of preparation given for a fee 
which is specifically designed or constructed to prepare or improve 
a test subject's score on a standardized test. 

(/ ) Test program** means all of the administrations of a test of the 
same name during a testing year. 

99152. Each test sponsor shall report the closing date of its testing 
year to the commission by February 1, 1985, or within 90 days after 
it first becomes a test sponsor, whichever is later. Each test sponsor 
shall report any change in the closing date of its testing year within 
90 days after thr change. 

99153. On or before November 15 of each year, the test sponsor 
shall submit to the conrniission all of the following data and 
information: 

(a) Three copies of each version of the test which was disclosed 
in the prior testing year, along with the corresponding acceptable 
answers, and the methods used to convert raw scores into the test 
scores reported to test subjects and test score recipients, together 
with an explanation of that method. 

(b) The dates of major or national administration of each test 
administered by the test agency during the testing year. 

(c) The total number of test subjects who have taken the test 
once, who have taken it twice, and who have taken it more than 
twice during the testing year. 
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(d) The total number of test subjects who registered for, but did 
not take, the test. 

(e) Th? total amount of fees received from test subjects by the test 
agency for the test for that testing year. 

(f) The expenses to the test sponsor of the test, as followrs: 

(1) Those expenses which are directly attributable to the test. 

(2) Those expenses which are indirectly attributable to the test. 
However, if the test sponsor also sponsors another test or related 
activities, it shall be sufficient for compliance with provisions of this 
section for the test sponsor to list indirectly attributable expenses, to 
the extent that they are identifiable, as they are proportionately 
related to the test. The test sponsor shall also list expenses indirectiy 
attribuUble to all activities of the test's sponsor, including expenses 
not identifiable as attribuUiDle to a test. 

The financial disclosure required by this section shall be submitted 
within 135 days after the close of the testing year and in sufficient 
detail to indicate the major categories of revenues and expenses 
associated witii the test. Except as provided in this section, the 
information for different testa administered by the same test sponsor 
shall be reported separately and by individual test 

(g) A copy of all documenta, pamphleta, and literature provided 
to the test su^ect and the test score recipient. 

(h) Where applicable, the national average test scores, state 
average test scores, the standard error of measurement, and any 
other existing information relevant to a comparison of the test scores 
of the state $ test subjecta with test scores of previous test subjects of 
the past five years. 

(i) For those testa used to predict academic performance, the 
most recent national or regional aggregation of data concerning the 
predictive validity of all of the following: 

(1) Academic record or grades alone. 

(2) Standardized test score alone. 

(3) Academic record and test score combined. 

(4) Standardized test scores over and above the predictive 
vaUcUty of academic record alone. 

(j) Using available data, the racial, ethnic, and sex breakdown of 
all test subjecta taking each test during the testing year. 

(k) If a separate fee is charged test subjecta fot admissions data 
assembly service, the test sponsor shall report information 
concerning the data assembly service in substantially the same form 
as would be required for a test under this section. 

(/ ) This section shall not be construed to require any test agency 
to submit to the conunission any reporta or documenta containing 
information relating to any individual test subject. Any information 
relating to any individual test subject shall be deleted or obliterated 
from any repofta or documenta filed with the conunission pursuant 
to this section. 

• (m) This section shall not apply to any standardized test which is 



ERLC 



32 



— 5 — 



Ch. 150?; 



administered to fewer than 3,000 test subjects in California during a 
testing year. 

99154. (a) Withiii 90 days of the close of each testing year, the 
test sponsor shall file with tije commission standard technical data 
sufficient to describe the psychometric quality of the test. 

For purposes of compliance with this section, it is sufficient to 
deposit with the. commissipn information conforming to the 
guidelines specified in the Standards for EducaUonal and 
Psychological Tests of the American Psychological Association, 
which were in effect 180 days prior to the testing year, and which are 
appropriate to the particular test and its uses. 

(b) Data, reports, or other documents submitted pursuant to this 
section shall be accompanied by a description of the test, including, 
but not limited to, the title, purpose or purposes of the test, and when 
and where the test wai: administered in the state. 

(c) Data, reports, or other documents submitted pursuant to this 
chapter shall not contain information in a form identifiable with 
individuals or parHcuIar postsecondary educational institutions. 

99155. Hie commission shall prepare and submit an annual 
report regarding standardized tests of the state's test subjects to the 
Governor, the Legislature, the Regents of the University of 
&lifornia, the Board of Govemon of the California Community 
Colleges, the Trustees of the California State University, the 
Califomia Postsecondary Education Commission, and the 
Superintendent of Public Instruction on or before March 1 of each 
^^.^•^ ^^^^ include a descripUve summary of existing data 
and information submitted to the commission pursuant to Section 
99153, including aU of the following: 

(a) The number of Califomia students taking standardized tests. 

(b) The performance of CaUfomia test subjects. 

(c) The predictive validity of test scores as specified in subdivision 
(i) of SecHon 99153. 

(d) A description of the information specified in subdivisions (a), 
(b), and (c) according to the sex and ethnicity of test subjects. 

(e) The revenues received by test sponsors, and the proportion of 
those revenues expended for test development and administration. 

99156. A test agency shall prepare a clear, easily understandable 
witten description of each standardized test it administers. A copy 
of the appropriate description shall be provided to the test subject 
or the test score recipient prior to the administration of the test or 
coinciding with the initial reporting of a test score. The description 
shall include all of the following information: 

(a) The purposes for which the test is constructed and intended 
to be used. 

(b) For those tests used to predict performance, the subject 
matter included on these tests and the knowledge and skiUs which 
the test purports to measure. 

(c) Statements designed to provide information for interpreting 
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the test scores, including the explanations of the test, the standard 
error of meamement, and for those tests used to predict 
perfomiance, the correlation between test score and performance. 

(d) Statemenb concerning the effects and uses of test scores, 
including both of the foUowing: 

(1) If the test score is used by itself or with other information to 
pred^ future grade pofait average, a summary of existing data on the 
extent to whidi the use of this test score will improve the accuracy 
of predicting future grade point average, over and above aU other 
information used 

(2) A summary of existing data on the extent to which the 
improvement in test scores results from test preparation courses. 

(e) A description of the form in which test scores will be reported, 
and whether the raw test scores will be altered in*any way before 
being reported to the test subject. 

(f) A complete description of any promises or covenanb which 
the test agency makes to the test subject with regard tc any of the 
foUowing matters: 

(1) The accuracy of scoring. 

(2) The time period within which ths test subject's score will be 
reported to the test subject and to the test score recipients. 

(3) The privacy of information relating to the test subject, 
including his or her test scores. 

(g) The prc^)erty interest in the test score held by the test subject, 
if any. 

(h) The period of time the test agency will retain the test score, 
and the test agency's policies regarding the storage, disposal, and 
future use of test scores. 

(i) A description of all special services which will be provided at 
the location of the test administration to accommodate handicapped 
or disabled test subjects. 

0) The policies and procedures of the test agency when there is 
a delay in reporting the test scores pursuant to Section 91160. 

(k) A representative set of sample test items. 

(/ ) The fees to be charged by the test sponsor for \ arious services 
made available to the test subject. 

(m) Each test agency shall comply with the requirements of this 
section beginning with the start of its testing year which begins after 
January 1, 1985. 

99157. (a) Within 90 da)s of the release to the test subject of the 
resulb of a standardi7.ed test as specified in subdivision (c) , and upon 
the request of the test subject, the test sponsor shall provide to the 
test subject an opportunity to examine operational test questions and 
answers under closely monitored conditions. The examination shall 
occur at a location to be mutually agreed upon by the test sponsor 
and test subject. 

Unless authorized by the test sponsor, questions, answers, or copies 
of questions or answers shall not be removed from the facility, except 
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by a representative of the test sponsor. During the examination of 
test materiab, the test subject may file with a representative of the 
test sponsor, and with an educational institution or institutions 
seeking results of the test examined, a written protest to any question 
or answer. 

(b) As an alternative to the procedure described in subdivision 
(a), and within 90 days of the release of the results of any 
standardized test score to the test subject, and upon request of the 
test subject, the test sponsor shall niake available to the test subject 
the test materials, including operational test questions, a copy of the 
test subject's response to each question, the test subject's raw scores, 
a copy of scoring and scaling instructions, a copy of the correct 
responses, and a copy of the conversion factor or table, or both. 

Each test sponsor shall, prior to the administration of a test, give 
written notification to the test subject of his or her right to request 
and receive test disclosure as provided in this section. 

(c) Except for test administrations described in subdivision ^d), 
the test sponsor shall provide to test subjects the test materials 
specified in subdivisions (a) and (b) for not fewer than 50 percent 
of regular test administrations, as determined by the test sponsor. If 
the application of 50 percent results in a number which includes f\ 
fraction, the number shall be rounded to the nearest larger whole 
number. 

(d) In order to accommodate test subjects who, because of 
religion, are unable to participate in regular test administrations, the 
test sponsor shall provide test materials specified in subdivisions (a) 
and (b) to test subjects of not fewer than one non*Saturday test 
administration during every 12-month period following December 1, 
1984. 

(e) Each test sponsor shall, prior to the administration of a test, 
give written notification to the test subjects of their right to request 
and receive test materials as provided in subdivisions (a), (b), and 
(c), provided that the request has been made within 90 days of the 
release of the ^est score to the test subject. 

(f) The test sponsors may charge a nominal fee, not to exceed the 
direct costs thereof, for test materials provided pursuant to this 
section. 

(g) For the purposes of this section only, a "standardized test" or 
"test'* means any test administered in California to at least 3,000 
individuals during a testing year and which is designed for, and 
formally required by, institutions of postsecondnry education in 
California for the purposes of admission to thooo institutions for 
undergraduate studies. This section does not apply to tests that have 
been administered for less than five years, the College Board 
Achievement tests, the Advanced Placement tests, the Medical 
College Admissions tests, or the test of English as a foreign language. 

99158. If the test agency will be delayed in reporting a test 
subjects score for a time period amounting to 10 calendar da/s 
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beyond the period specified in paragraph (2) of subdivision (f) of 
Section 99156» the test agency shall notify the test subject 
immediately. The notice shall indicate the reasons for delay» 
including, but not limited to, incorrect, incomplete, or inconsistent 
personal identLfving information fumidied by a test subject 

99159. ' (a) Whenever a test agency is presented with information 
whteh renders the test subject's test score suspect, whether that 
information is in the form of allegations of collusion or cheating, or 
irregular test administration, or irregular statistical data, or any other 
fonrm, the test agency is responsible for revieving the information 
and determining if withholding the test subject's score is warranted. 

(b) If the test agency determines that withholding the test 
subject's score is wa ranted, the test agency shall give the test subject 
written notice of the test agency's decision. The notice shall be sent 
by registered mail not later than five working days after the test 
agency's decision. 

(c) The notice to the test subject shaU include all of the following: 

(1) A complete summary ofthe information submitted to the test 
agency and relied upon by the test agency to withhold the score. 

(2) A complete sununary of the pertinent facts surrounding the 
investigation. 

(3) A statement of the test subject's right to receive, upon request, 
details supporting complete summaries referred to in paragraphs ( 1 ) 
and (2). 

(4) The policies and procedures that were followed by the test 
agency in reviewing and rendering a decision to withhold the test 
score. 

(5) The potential consequences which may result from the 
investigation, such as withholding or invalidating the test scores. 

(6) A summary of the information that may be submitteci to the 
test agency by the test subject to support the authenticity of the test 
score. 

(7) A statement informing the test subject that the opportunity to 
respond to the notice will be afibrded for not more than 15 working 
days following the date the notice was delivered No final decision 
on the question of suspected irregularity or inauthenticity shall be 
rendered by the test agency until the test subject under investigation 
has responded, or the time for doing so has expired, whichever 
occurs first. 

(d) After the time period specified in paragraph (7) of S' ibdlvision 
(c) has expired, the test agency shall review all of the evidence and 
shall render a dedsion regarding the authenticity of the score. 

No test agency shall cancel or invalidate a test subject's test scores 
on the basis of an alleged irregularity or inauthenticity unless, after 
all evidence has been considered by the test agency, substantial 
evidence resulting from an investigation conducted pursuant to this 
section supports 3ie cancellation or invalidation. 

99160. (a) Whenever the test agency determines that substantial 
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evidence exists to support cancellation or invalidation of a test score, 
the test agency shall provide the test subject with a choice of the 
following options: 

(1) A cancellation of the test scores in question, with full refund 
of aC toit fees. 

(2) Opportunity to take the test again privately and without 
charge. 

(3) Opportunity to seek Judicial review of the matter. 

(b) The test subject shall have 30 days following receipt of the 
notice by registered mail to respond to the notice of inauthenticity. 

(c) If the test subject responds to the notice of inauthenticity or 
irregularity of test scores sent by the test agency within the time 
period specified by subdivision (b), the test agency shall review the 
contents of the response and com^y with one of the following: 

(1) If the test subject requests cancellation of the test scores, a full 
refmid of all test fees will be provided within a reasonable period. 

(2) If the test subject requests an opportunity to take the test 
again privately and without charge, the test agency shall make 
appropriate accommodations that are mutually agreed upon by the 
test agency and test subject so that the test subject has sufncient time 
to prepare for the retest The retest shall be given in a reasonable and 
timely manner. 

(3) Nothing in this section precludes the parties from seeking 
resolution of the testing problems by either Judicmt review or 
arbitration. 

(d) The teu^t agency shall not release confidential information to 
any authorized test score recipients regarding a test subject under 
pending investigation, unless authorized to do so by the test subject. 

(e) The test agency shall inunediately release the test score to the 
test subject and the test score recipients where no substantial 
evidence exists to render the inauthenticity or irreguarity of the test 
score. 

(f) The procedures prescribed in Section 99159 and this section do 
not apply to instances where the cancellation of all test scores results 
from the complete disruption of the administration of the test, such 
OS by natural disasters, national emergencies, inadequate or 
improper test conditions, answer sheet printing errors, or testing 
agency errors. 

(g) Thne procedures described in Section 99159 and this section 
shaH not apply in those instances where test scores have already been 
reported to test score recipients. 

99161. (a) No test agency shall release or disclose any test score 
identifiable with any individual test subject, in any form whatsoever, 
to any test score recipient, unless the agency is speciHcally 
authorized by the test subject to release that test score to the 
recipient. A test agency may, however, release ail scores received by 
a test subject on a test to anyone designated by the test subject to 
receive the test score. 
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(b) A test agency may release test scores and other information 
in a form which does not identiiy any individual test subject for 
purposes of research, studies, and reports primarily concerning the 
test itself. 

99162. Any infopnation or report required to be submitted to the 
commission pursuant to this chapter shall be puMic record subject to 
disclosure under die provisions of Chapter 3JS (commencing with 
Section 6290) of Division 7 of Title 1 of the Government Code. 

Nothing in this section shall be construed to diminish or authorize 
die infHi^ement of any rif^ts protectaKl fay law relating to copyright, 
to the protectloo of tnde secrets, or other proprietary rights. 

99163. Any test nonsor intentionally violates any provision 
of this chapter diall be liable for a civil penalty not to excMd seven 
hundred fUty ddlars (1790) four each violation. 

99164. If any provision of this chapter or ^ application thereof 
to any person or circumstances Is hdd invalid, the invalidity shall not 
affect other provisions or q>irfications of the chapter which can be 
given effect without the invdid provision or application, and to this 
end the provisions of this diapter are severable. 
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The College Board 

Sute 480. 2099 Gateway Place 
San Jose, California 95iiO 
(408)288-68^ 

Westtm Regonai OfJ»ce 



Or. Horace Crandell 

Post Secondary Administrator 

California Post Secondary Education Commission 

1020 Twelfth Street 

Sacramento » CA 95814 



Dear Dr. Crandell: 

The Callforitia Education Code, Psrt 65, Chapter 3, requires the College Board, 
as a sponsor of standardized tests, to file with the Commission specified 
Information for the Preliminary Scholastic Aptitude Test. The enclosed 
Information related to this test Is submit';- d In compliance with the 
requirements of Section 99154. 

Sincerely, 

Jonn Vaccaro 
Director 

Admission 8t Guidance Services 

September 25, 1986 
JBV/emp 

Enclosures: 

(1) PSAT/NMSQT Interpretive Hanual, 1985 
(1) About Your PSAT/NHSQT Scores, 1985 

(1) ETS Test Analysis Report of tne PSAT/NHSQT October, 1985, 

Administrations Report No. SR-B6-109, 
(1) A Counselor's Guide to Helping Students Learn From the PSAT/NHSQT 
(1) 1985 Student Bulletin For the PSAT/NHSQT 

(1) Listing of Schools that Received Student Reports or Administered the 
PSAT/NHSQT on Saturday, October 19, or Tuesd.<y, October 22, 1985 
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The College Board 

Suite 480, 2099 Gateway Place 
San Jose, California 951 10 
(408) 288*6800 

Wtstern Regional Office 



Or. Horace Crandell 

Post Secondary Administrator 

California Postsecondary Education Commission 

1020 Twelfth Street 

Sacramento, CA 95814 



Oear Or. Crandell: 

Education Code Section 99151 requires the College Board, as a test 
sponsor, to file with the Commission certain Information specified In 
Section 99153. The enclosed Information Is for the Preliminary 
Scholastic Aptitude Test/National Merit Scholarship Qualifying Test. 

Sincerely, 

John Vaccaro 
Director 

Admissions & Guidance Services 

November 11 , 1986 
JBV/emp 

Enclosures: 

(1) Section 99153 (c) (d; Test faking Pattern Information 

(1) Section 99153 (e) (f) Financial Information 

(3) Form S October 19, 1985 PSAT/NMSQT 

(3) Form T October 22, 1985 PSAT/NMSQT 

(1) Answer Keys for Form S and Form T of the 1985 PSAT/NMSQT 

(1) Student Bulletin, 1985 PSAT/NMSQT 

(1) About Your 1985 PSAT/NMSQT Scores 

(1) 1985 PSAT/NMSQT Supervisor's Manual 

(1) 1985 PSAT/NMSQT Interpretive Manual 

(1) Counselor's Guide to Helping Students Learn from the PSAT/NMSQT 

(1) PSAT/NMSQT Summary Report for National, Regional, and California 

College BoarJ Juniors, 1985 

(1) Announcement of 1985-86 Test Dates 

(1) 1985 PSAT/NMSQT California Summary Reports By Ethic Background 
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THE COLLEGE BOARD 



Report to the California Postsecondary Education 
Commission Pursuant to California Education Code (Senate Bill 1758 - Torres) 

State of California 



The following information is provided in compliance with Section 99153 (c) (d). 

This data Is based on all national and international test administrations of 
the PRELIMINARY SCHOUSTIC APTITUDE TEST/NATIONAL MERIT SCHOLARSHIP QUALIFYING 
TEST during the 1985-86 testing year. 



PSAT/NMSQT 
l£St 

The total number of times the tfejt was 

taken during the testing year 1,545,859 

The number of individuals who took 
the test 

Once 1,545,859 
Twice -0- 
More than twice -0- 

The number of individuals who regi..td=H' 

for but did not take the test N/A' 

*The PSAT/NMSQT is school -aa..i1nistered; tberetore, students do 
not register individually. 



Oclober 10, 1986 
RFM/llp 
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Torres Report For Year Fnripd June 30. 1986 
The following information is provided in compliance with Section 99153 <e) 

PSAT/NMSOT TEST 



Fees received from test takers in 
the College Board's PSAT/NMSQT Test 

Test Fees 



$ 7.768.392 



The following information is provided in compliance with Section P9153 (f) 

PSAT/NMSQT TFST 



Expenses directly Attributable 
to the PSAT/NMSQT Test 

Cost of Test Administration 

Direct support of test administration: 
publications, transcript services, essay 
readings, etc. 

Program direction 



Expenses indirectly attributable 
to the PSAT/NMSQT TEST 

Support services: publications 
regional offices, etc. 

Associational and Administrative 
expense 

Research and Development 



Total expense directly and indirectly 
attributable to PSAT/NMSQT test 



$ 541.062 



474,130 
700.17: 

i i ■7i«>.:^63 
P SAT/NHSOT TE ST 



$ 458,571 



151,138 

233.334 
$.J43.]43 



$ 2.558.506 



o 
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Torres Report for Year Ended June 30. 1986 

Expenses Identifiable as Scholastic Aptitude Test Achievement Test, PSAT/NMSQT 
Test and Advanced Placement Tests have been allocated thereto. Joint costs 
have been allocated based on the Test volumes Involved. 

The following Information Is also provided In compliance with Section 99153 (f) 

Total 

Total expense attributable to all 
activities Including expenses not 
identifiable as attributable to 
the test 

Support services: publications. 

general offices, etc. . $10,380,011 

Assoclatlonal and administrative 

expense 9,9'6,029 
Research and Development 3.449.181 



Scholastic Aptitude Test and 
College Board Achievement Tests 
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The College Board 

Suite 480. 2099 Gateway Place 
San Jose, California 95110 
(408)288-6800 



Western Regional Office 



Or. Horace Crandell 

Post Secondary Administrator 

California Postsecondary Education Commission 

1020 Twelfth Street 

Sacramento, CA 95814 



Dear Or. Crandell: 

The California Education Code Part 65, Chapter 3, requires the College Board 
as a sponsor of standardized tests, to file with the Commission specified ' 
information for the Scholastic Aptitude Test and the College Board Achievement 
Tests. The enclosed Information related to these tests Is submitted In 
compliance with the requirements of Section 99154. Additional technical data 
describing the psychometric qualities of the test are Included In The College 
Board Techn cal Handbook for the Scholastic Aptitude Test and Achievement 
Tests. (1984), which was filed with the Commission In September, 1985. 

Sincerely, 

Jonn Vaccjro 
Director 

Admission 8. Guidance Services 

September 2*5, 1986 
JBV/emp 

Enclosures: 

Using Your College Planning Report, 1986-87 
ATP Guide for High Schools and Colleges, 1986-37 
Registration Bulletin, 1986-87 (Western Ec^ltlon) 
Supervisor's Manual, 198^-87 
Taking the SAT 

Taking the Achievement Tests 
Test Center List, 1985-86 
Ci liege Planning Report 
College Counseling Report 
College Admissions & Advising Report 
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The College Board 

Suite 480, 2099 Gateway Place 
San Jose, California 951 10 
(408) 288-6800 

Western f^egionai Office 



Dr. Horace Crandell 

Post Secondary Administrator 

California Postsecondary Education Commission 

1020 Twelfth Street 

Sacramento, CA 95814 



Dear Dr. Crandell: 



Education Code Section 99151 requires the College Board, as a test 
sponsor, to file with the Commission certain Information specified In 
Section 99153. The enclosed Information Is for the Scholastic 
Aptitude Test and the College Board Achievement Tests. SAT 
performance by ethnic background Is not available for 1985-86 
graduates. 



Sincerely, 

John Vaccaro 
Director 

Admissions & Guidance Services 



November 11, 1986 
JBV/emp 



Enclosures: 

(1) Section 99153 (c) (d) Test Taking Pattern Information 

(1) Section 99153 (e) (f) Financial Information 

(3) 5 SATS, 1986 Edition 

(1) Registration Bulletin, SAT and Achievement Tests, 1986-87 

(1) Taking the SAT 

(1) Taking the Achievement Tests 

(1) Using Your College Planning Report, 1986-87 

(1) 1986-87 ATP Guide 

(1) Guidelines on the Uses of College Board Test Scores & Related Data 

(1) Announcement of 1985-86 Test Dates 
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THE COLLEGE BOARD 



Report to the California Postsecondary Education 
ComrLission Pursuant to California Education Code (Senate Bill 1758 - Torres) 

State of California 



The following information is provided in compliance with Section 99153 (c) (d). 

This data is based on all national and international test administrations of 
the Scholastic Aptitude Test during the 1985-86 testing year. 



Scholastic 
Aptitude 
Te st 



The total number of times the test was 
taken during the testing year 



1,819.035 



The number of individuals who took 
the test 



Once 
Twice 

More than twice 



1,471,119 
156,357 
11,335 



The number of individuals who registered 
for but dio not take the test 



168,636 



October 10, 1986 
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Torres Report For Year gnded June 30. 1986 
The following Information Is provided In compliance with Tectlon 99153 (e) 

Scholastic 

^ ^ ^ Aptitude Test 

Feas received from test takers In 
the College Board's SCHOLASTIC 
APTITUDE TEST 

Test Fees $20,918,500 
Transcripts, Score Reports, etc. $ 11.358.739 

$ 32.277.2? q 

The following Information Is provided In compliance with Section 99'i53 (f) 



Expenses directly Attributable 
to the SCHOUSTIC APTITUDE TEST 



Expenses Indirectly attributable 
to the SCHOUSTIC APTITUDE TEST 



Scholastic 
Aptitude Test 



Test development-, ar.diysls and 

validation ^ 2,076,604 

Cost of Test Adralnl strati 0',t 16,086,600 

Direct: su;-)ort of test aamlnl strati on: 

publications, transcript services, essay 

reart^ngs, nc. lu. 42 5. 349 

Summary reporting services 687,920 

Program direction 520.319 

$29,796,792 



Scholastic 
Aptitude Test 



Support services: publications 

regional offices, etc. $ 1,716,612 

Associatlonal and Administrative 

expense 2,018,400 

Research and Development 464.541 

$ 4,199.553 

Total expense directly and indirectly 

attributable to SCHOUSTIC APTITUDE TEST $ 33.996.345 
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Torres Report for Year Ended June 30. 1986 

Expenses identifiable as Scholastic Aptitude Test, Achievement Test, PSAT/NMSQT 
Test and Advanced Placement Testa have been allocated thereto. Joint costs 
have been allocated based on the Test volumes involved. 

The following information Is also provided in compliance with Section 99153 (f) 

Total 

Total expense attributable to all 
activities including expenses not 
identifiable as attributable to 
the test 

Support services: publications, 

general offices, etc. $10,380,011 
Associatlonal and administrative 

expense 9,916,029 

Research and Development 3.449.181 

$ 23.745.221 
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November 25, 1986 



Horace F. Crandell 

Postsecondary Education Administrator 
California Postsecondary Education Commission 
1020 12th Street, Second Floor 
Sacramento, California 95814 

Dear Mr. Crandell : 

In compliance with Senate Bill 1758 of the Education Code related to standard 
ized testing. The American College Testing Program, Inc. (ACT) hereby files 
the prescribed information as required by the law. 

(1) The beginning and ending dates of ACT'^ testing year are September 1, 
and August 31, respectively. 

(2) Total times test was taken during the testing year 

ending August 31, 1986 

Individuals taking the test once 
Individuals taking the test twice 
Individuals taking the test more than twice 

Individuals who registered but did not take the test 

Total amount of fees received from test subjects 



Direct expense for testing program: 

Test Adm., Scoring and Reporting 
Research and Development 

Secondary & Postsecondary Institutions Support 

Services 
Program Administration 

Total Direct Expense 

Indirect Expenses 

(3) ACT does not offer an admissions data assembly service. 

(4) Copies of each general publication prepared for routine distribution 
tc test subjects and test score recipients are enclosed. 

(5) Research data pertaining to test scores for California and the nation 
are enclosed. Research reports that have not be updated since our 
last filing have not been repeated with this filing. 



1,088,692 

806,678 
125,584 
9,925 

102,979 

$13,743,549 



$ 8,919,873 
546,777 
1,361,128 

583,219 
$11,410,997 

$ 1,688,362 




2201 North Dodge Street P.O. Box 168 
Iowa City. Iowa 5224?. 

(3i9) 337-1000 
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Horace Crandell 
November 25, 1986 
Page 2 



(6) Copies of each general publication prepared for routine distribution to 
ACT participating colleges and universities are also enclosed. 

This completes our filing for the 1985-86 testing year. Please let me know 
if additional materials are required under the law. Questions concerning 
the information we have filed should be referred to Mr. Ted Bartell in our 
Sacramento Office, telephone 916/921-2323. 



Joe B. Pu^ffi, Jf. 
Vice President 
Business and Finance 

JBP/cd 

cc: Ted Bartell, AVP, Western Region 
Enclosures 



Sincerely 
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EXHIBITS 



Exhibits A-1 

Through A-4: Three copies of each version of the ACT Assessment disclosed 
during the 1985-86 testing year, along with the corresponding 
answers » the methods used to covert raw scores into test 
scores» and an explanation of the method used. (Forms 26F, 27A, 
27E. 27B) 



Exhibit 


B: 


Registering for the ACT Assessment (combined East/West Reg ■« 
Contains: 

a. The dates of national administration of the ACT 
Assessment (page 1 ) 

b. Registration Information (page 1) 

c. Score reporting Information (page 1 & 2) 

d. The ACT Interest Inventory (page 5) 

e. The Student Profile Section (pages 6-10) 


Exhibit 


C: 


Preparing for the ACT Assessment 


Exhibit D: 


Using Your ACT Assessment Results 


Exhibit 


E: 


ACT ssessment Student Information 


Exhibit F: 


Content of the TEsts in the ACT Assessment 


Exhibit 


G: 


Using the ACT Assessment on Campus 


Exhibit 


H: 


Counselor's Handbook 


Exhibit 


T ; 


The ACT Assessment Test Preparation Reference Manual for 
Teachers and Counselors 


Exhibit 


J: 


ffH A. * ^ • ^ ^ lift" * ^ * 

Reporting Services for Colleges and Universities 


Exhibit 


K: 


Research and Information Services 


Exhibit 


L & M: 


High School Profile Report Composite for California 
High School Profile National Composite 


Exhibit 


N: 


Trend TAbles for ACT- Tested Students in California (contains 
racial/ethnic, sex, ect. breakdown) 


Exhibit 


0: 


ACT Class Profile Report - National Norms 


Exhibit 


P: 


Research Services Summary Tables (1982-83, 1983-84, 1984-85) 


Exhibit Q: 


Helping Students Grow 


Exhibit 


R: 


Educational Opportunity Service 


Exhibit 


S: 


Request for ACT Assessment Special Testing 


Exhibit 


T: 


ACT Planning Guide 
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The College Board 

Suite 480. 2099 Gateway Place 
San Jose, California 95110 
(408) 288-6800 

Western Regional Office 



Or. Horace Crandell 

Post Secondary Administrator 

California Postsecondary Education Commission 

1020 Twelfth Street 

Sacramento, CA 95814 



Dear Or. Crandell: 

The California Education Code, Part 65, Chapter 3, requires the College Board, 
as a sponsor of standardized tests, to file with the Commission specified 
Information for the Advanced Placement Examinations. The enclosed Information 
related to these tests Is submitted In compliance with the requirements of 
Section 99154. 



Sincerely, 




John Vaccaro 
Director 

Admission & Guidance Services 



September 25, 1986 
JBV/emp 

Enclosures: 

(1) Bulletin for Students, Advanced Placement Program, May, 1986 

(1) A Guide to the Advanced Placement Program, 1987 (will be se.>t/not 

yet available) 
(1) Advanced Placement Course Description, Art 
(1) Advanced Placement Course Description, Biology 
(1) Advanced Placement Course Description, Chemistry 
(1) Advanced Placement Course Description, Computer Science 
(1) Advanced Placement Course Description, English 
(1) Advanced Placement Course Description, French 
(1) Advanced Placement Course Description, German 
(1) Advanced Placement Course Description, Government and Politics 
(1) Advanced Placement Course Description, History 
(1) Advanced Placement Course Description, Latin 
(1) Advanced Placement Course Description, Mathematics 
(1) Advanced Placement Course Description, Music 
(1) Advanced Placement Course Description, Physics 
(1) Advanced Placement Course Description, Spanish 

(1) Advanced Placement Program: Bulletin For Students Cal. Supplement (will 

be sent/not yet available) 
(1) Advanced Placement Program: Bulletin for Students, May, 1987 (will be 

sent/not yet available) 
(1) Report of Schools Sending Candidates to Advanced Placement Examinations: 

May. 1986 
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^tofit educational association serving students, schools, and colleges through programs designed to expand educational opportunity. 



The College Board 

Suite 480, 2099 Gateway Place 
San Jose, CaHfornia 95110 
(408) 288-6800 

Wtstern Regional Office 



Or. Horace Crandell 

Post Secondary Administrator 

California Postsecondary Education Commfssl'on 

1020 Twelfth Street 

Sacramento, CA 95814 



Dear Or* Crandell 

Education Code Section 99151 — requires the College Board, as a test 
sponsor, to file with the Commission certain information specified in 
Section 99153. The enclosed information is for the Advanced Placement 
Examinations. 

Sincerely, 

John Vaccaro 
Director 

Admissions & Guidance Services 

November 11, 1986 
JBV/emp 

(1) Section 99153 (c) (d) Test Taking Pattern Information 

(1) Section 99153 (e) (b) Financial Information 

(1) Bulletin for Students, Advanced Placement Program 

(1) A Guide to the Advanced Placement Program 

(1) 1986 Coordinator's Manual, AP Exams. May 5-8, 12-16, 1986 

(1) School Administrator's Guide to the Advanced Placement Program 

(1) 1986 AP National and California Summary Reports 

(1) 1985-^/6 I est Dates, Advanced Placement Examination 
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THE COLLEGE BOARD 



Report to the California Postsecondary Education 
Commission Pursuant to California Education Code (Sen?te Bill 1758 - Torres) 

State of California 



The following information is provided in cc^.pliance with Section 99153 (c) (d). 

This data is based on all national and international test administrations of 
the Advanced Placement Program during the 1985-86 testing year. 



Advanced 
Placement 
Examination 



The total number of times the examination 
was taken during the testing year 



319.224 



The number of individuals who took 
the examination 



Once 
Twice 

More than twice 



319.224 
-0- 
-0- 



The number of individuals who registered 
for but did not take the examination 



Advanced Placement students register at 
time of the examination administration. 



October 10. 1986 



RFH/llp 
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Torres Report For Year Ended June 30. 1Q86 
The following information is provided in compliance with Section 99153 (e) 



Fees received from examinition takers in 
the College Board's ADVANCED PLACEMENT 
PROGRAM (APP) 

Examination Fees 



ADVANCED PLACEMENT PROGRAM 



$14,410,339 



The following information is provided in compliance with Section 99153 (f) 



Expenses dir«>ct1y attributable 
to the ADVANCED PLACEMENT PROGRAM 

Examination development, analysis and 
validation 

Cost of Examination Administration 



ADVANCED PLACEMENT PRQGP^M 

$ 1,827,372 
5,595,393 



Direct support of examination ad.nini strati on: 
publications, transcript services, etc. 

Program Direction 



1,675,C91 

542.128 

^ 9.S.39.q84 



Expenses indirectly attribucable 
to the ADVANCED PLACEMENT PROGRAM 

Support services: publications 
regional offices, etc. 

Associational and Administrative 
expense 

Research and Development 



ADVAr.'CED PLACEMENT PROGRAM 



$ 2,018,819 



828,213 

351.345 

^ 3.198.377 



Total expense directly and indirectly 
attributable to ADVANCE PLACEMENT PROGRAM 



$ 12.838.361 
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Torrps Report for Year Ended June 30. 1986 



Expenses identifiable as Scholastic Aptitude Test, Achievement Test, PSAT/NMSQT 
Test and Advanced Placement Tests have been allocated thereto. Joint costs 
have been allocated based on the Test volumes involved. 

The following information is also provided in compliance with Section 99153 (f) 

Total 

Total expense attributable to all 
activities including expenses not 
Identifiable as attributable to 
the test 

Support services: publications, 

general offices, etc. $10,380,011 
Associational and administrative 

expense 9,916,029 

Research and Development 3.449.181 

^'-745.221 
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Test of English as a Foreign Language 
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TEST OF ENGLISH AS A FOREIGN LANGUAGE 

CN 6155 • PrincGton, NJ 08541-6155 • USA 



Telephone 609-921-9000 • Cable EDUCTESTSVC • Telex 843420 EDUTESTSV PRIN 



November 14, 1986 



California Postsecondary Education 
1020 Twelfth Street 
Sacramento, CA 95814 



Attention: Mr. Horace F, Crandell 

Postsecondary Education Administration 



Dear Mr. Crandell: 

In accordance with the revised Education Code, Senate Bill No. 1758, 
Chapter 1505, Part 65, Chapter 3, Section 99152-99159, the enclosed data 
and publications are submitted on behalf of the TOEFL Program. The data 
are for the test year July 1, 1985 - June 30, 1986. 



The enclosures include the following item?: (1) Program report for 
the Commission, (2) 3 copies of each of the test forms used at the July 
12, 1985, August 3, 1985,* Novetabpr 16, 1985, December 6, 1985 and May 
10, 1986 TOEFL Test Administration, together with a copy of the correct 
answer responses, and the score conversion tables for each test form, 
(3) TOEFL Bullet in of Information and Application Form - 
International/Special Center Testing Program, (4) Examinee s Handboo k 
and Admission Form - Institutional Testing Program, (5) Institutional 
Testing Program Brochure, (6) TOEFL Test and Score Manual, 1985 
Edition, (7) TOEFL Request Form, (8) Appendices A and B - the location 
of TOEFL test centers in California, and (9) Test Security Brochures. 




TOEFL Policy Council 



JDM:SRC:gla 
Enclosures 
Certified Mail 
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Test of Spoken English 

Secondary Level English Proficiency Te^t ■ 



TEST OF ENGLISH AS A FOREIGN LANGUAGE 
July 1, 1585 - June 30, 1986 



Report prepared for the California 
Postsecondary Education Commission 



November 1, 1986 

63 
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99153. On or before November 15 of each year, the test sponsor shall 
submit to the Commission all of the following data and Information: 

(a) Three versions of the test which were used i the prior testing 
year, along with the corresponding acceptable answers, and the methods 
used to convert raw scores Into the test scores reported to test subjects 
and test score recipients, together with an explanation of that method. 



991^^3. (a) Enclosed are three copies of each of the test forms used 
at the (1) August 3, 1985, (2) November 16, 1985, and (3) May 10, 1986 
International TOEFL test administrations and three copies of each of the 
test f'>rm8 used at the (1) July 12, 1985 and (2) December 6, 1985 Special 
Center TOEFL test administrations. AI30 included are cassette recordings 
of the stimulus ma^erial for the listening comprehension section, the 
correct answers for each test form and the score conversion tables. 

These test forms are equivalent to those used at each TOEFL adminis- 
tration, but they are no longer in use as secure tests. 
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99153. (b) The dates of major or national administration of each 
test administered by the test agency during the testing year, 

(c) The total number of test subjects who have taken the test once, 
who have taken it twice, and who have taken it more than twice during 
the testing year. 

(d) The total number of test subjects who registered for, but did 
not take, the test. 

(e) The total amounts of fees received from test subjects by the 
test agency for test for that testing year. 

(f) The expenses to the test sponsor of the test, as follows: 

(1) Those expenses vhich are directly attributed to the test. 

(2) Those expenses which arc indirectly attributed to the test. 

(g) A copy of all documents, pamphlets, aad literature provided to 
the test subject and the test score recipient. 

(h) Where applicable, the national average test scores, state 
average test scores, the standard error of measurement, and any other 
existing information rele\^ant to a comparison of the test scores of the 
state's test subjects with test scores of previous test subjects of the 
past five years. 

(i) ^or those tests used to predict academic performance 

(j) Using available data, the racial, ethnic, and sex breakdown of 
all test subjects taking each test during the testing year. 

(k) If a separate fee is charged tet^t subjects for admissions data 
assembly service .... 

(1) The provisions of this section shall not be construed to require 
any test agency to submit to the Commission any reports or documents 
containing information relating to any reports or documents filed with the 
Commission pursuant to this section. 



99153. (b) The dates of major or national administrations of TOEFL 
are as follows: 

The International Testing Program which always tests on a Saturday 
provides testing six times a year at approximately 1,100 test centers 
established by ETS throughout the world. Test dates in 1985-86 were: 
August 3, 1985; October 26, 1985; November 16, 1985; January 11, 1986; 
March 8, 1986; and May 10, 1986. 
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The Special Center Testing Program schedules test administrations on 
Fridayb at usually the same test centers as the International program. 

The program was integrated with the International TOEFL testing program in 
1979 to provide monthly testing with alternate Friday and Saturday test 
dates. Testing was conducted throughout the world in 1985-86 for this 
program on July 12, 1985, September 20, 1985, December 6, 1985, February 
7, 1986, April 11, 1986, and June 6, 1986. 

(c) ETS records prepared by the Answer Sheet Scanning Department 
indicate the Test of English as a Foreign Language (TOEFL) was taken 
428,554 times during 1985-86. Of this total 54,437 were answ^.r sheets 
sent to ETS for scoring under its Institutional Testing programs. It is 
possible additional test subjects took the TOEFL under this service and 
the answer sheets were scored by the testing institution. Such test 
subjects are not recorded at ETS. 

Information on the number of times an individual has taken TOEFL 
during the testing ,ear is collected on the registration form. The 
infoimation is self-reported and cannot be verified by ETS. Those 
individuals who \»pplied to r.ake TOEFL during 1985-86 and who provided this 
information are distributed as follows: 



Once during 1985-86 214,565 
Twice 80,983 
More than twice 79,946 

(d) In 1985-86, 62,368 registered for but did not take the TOEFL 
under the International and Special Center testing programs. Registration 
records for the Institutional TOEFL •ic:sting Prograir are kept by the 
institutions administering the test and ace not available to ETS. 

(e) The total amount of fees received from test takers during 
1985-86 was $14,6^8,134. This represents four categories of income. 

a. Registration fees paid by individual test subjects. 

b. Additional transcripts requested by individual test subjects- 

c. Fees paid by institutions for Institutional Administration forms, 
under the Institutional Testing Programs, test forms are distributed 
directly to the institutions. Individual test subjects for these programs 
are not registered directly by ETS. 

d. Program • ublications and services ordered by examinees. 
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(f) (1) Expenses directly attributed to the test (July 1, 1985 - 
June 30, 1986) 

Program Direction $1,267,137 

Test Administration and Related Services- International, 
Special Center, US/Canada and Overseas Institutional Testing 
Programs 7,778,800 

Service-Additional Requests for Transcripts .... 323,842 

Test Development /Production 1,786,221 

Publications 1 ,395 ,544 

Research 362,259 

TOTAL . . $12,913,803 

(2) Expenses indirectly attributed to the test (July 1, 1985 - 
June 30, 1986). 

Policy Council and rcilatad activities 135,372 

General Research 96,415 

Developmetit Studies 217 ,143 

TOTAL . • $448,930 



(g) each TOEFL applicant registering for the International or 
Special Center program receives a copy of the TOEFL Bulletin of Information . 
Applic^ints for the Institutional Testing Program received a copy of 
Examinee Handbook and Admission Form. 



Test score recipients include the examinees and universities, colleges 
or other agencies. The examinees receive copies of their score and a 
TOEFL Request Form for additional Official Score Reports. The colleges, 
universities and other agencies receive copies of examinees' score reports 
as designated by the examinee and each test score user receives a copy of 
the TOEFL Test and Score Manual . Copies of above publications are enclosed. 

(h) National average and state average test scores are not available 
for the TOEFL test, however, information on the standard error of measure- 
ment and other statistical characteristics of the test \(iny be found on 
pagas 25-31 in the TOEFL Test and Score Manual . 

(i) Not applicable. TOEFL is not used to predict academic performance. 

(j) Statistical data by ethnic background is not available. Tables 
7 and 8 on page 22 of the Test and Score Manual provides means and standard 
deviations of test scores by sex. 

(k) TOEFL does not offer admissions data assembly service. 

(1) None of the statistical data is individually identifiable. 
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99154. (a) Within 90 days of the close of each testing year, the 
test sponsor shall file with the Commission standard technical data 
sufficient to describe the psychometric quality of the test. 

For purposes of compliance with this section, it is sufficient to 
deposit with the Commission information conforming to the guidelines 
spscified in the Standards for Educational and Psychological Tests of the 
American Psychological Association, which were in effect 180 days prior 
to the testing year, and which are app*"opriate to the particular test 
and its uses. 

(b) Data, reports or other documents submitted .pursuant to this 
chapter shall be accompanied by a description of the test, including, but 
not limited to, the title, purpose or purposes of the test, and when 

and where the test was administered in the state. 

(c) Data, reports or other documents submitted pursuant to this 
chapter shall not contain information in a form identifiable with 
individuals or particular postsecondary educational Institutions. 



99154. (a) The reqxiested information appears in the enclosed TOEFL 
Test and Score Manual , pp. 20-31. 

(b) A description of the test appears in the TOEFL Test and Score 
Manual, pp. 7-8. A description of the test and its purpose is also 
provided each applicant in the 1985-86 Bulletin of Information on page 3, 
and in the Handbook for Examinees on page 24-31. 

Lists of the location and dates of all TOEFL test administrations 
within within the state of California during test year 1985-86 are 
attached. The liste for the International and Special Center test 
programs are marked "Appendix A." The test sites and test dates for the 
Institutional testing program are marked "Appendix B." 

(c) None of this data is individually identifiable — either by 
examinee or by institution. 
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99156. A test rgency shall prepare a clear, easily understandable 
written descript^cri of each standardized r st it administers. A copy of 
the appropriate description shall be proviaed to the test subject or the 
test score recipient together with the test registration forms and related 
documents, prior to the administration of the test or coinciding with the 
initial reporting of a test score. The description shall include all of 
thp following information: 

(a) The purposes for which the test is constructed and intended to 
be used. 

(b) For those tests used to predict performance, the subject matter 
included on these tests and the knowledge and skills which the test 
purports to measure. 

(c) Statements designed to provide information for interpreting the 
test scores , including the explanations of the test, the standard error of 
measurement, and the correlation between test score and performance. 

(d) Statements concerning the effects and uses of test scores, 
including the following: 

(1) If the test score is used by itself or with other information 
to predict future grade point average, a summary of existing data on the 
extent to which the use of this test score will improve the accuracy of 
predicting future grade point average, over and above all other information 
used. 

(2) a summary of existing data on the extent to which the improvement 
in test scores results from test preparation courses. 

(e) A description of tlie form in which test scores will be reported, 
and whether the raw test scores will be altered in any way before being 
reported tc the test subject. 

(f) A complete description of any promises or covenants which the 
test agency makes to the test subject with regard to any of the following 
matters: 

(1) The accuracy of scoring. 

(2) The time period within which the test subject's score will be 
reported to the test subject and to the test score recipients. 

(3) The privacy of information relating to the test subject, including 
his or her test scores. 

(g) The property interest in the te.-^t score held by the test subject, 
if any. 
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(h) The period of time the test agency will retain the test score, 
and the test agency's policies regarding the storage, disposal, and future 

• use of test scores. 

(i) A description of all special services which will be provided at 
the location of the test administration to accommodate handicapped or 
disabled test subjects. 

(j) The policies and procedures of the test agency when there is a 
delay in reporting the test scores pursuant to Section 91160. 

(k) A representative set of sample test items. 

(1) The fees to be charged by the test sponsor for various services 
made available to the test subject. 

(m) Each test agency shall con^ly with the requirements of this 
section beginning with the start of its testing year which begins after 
January 1, 1985. 



99156. (a) For International or Special Center TOEFL test takers 
the required information appears on page 3 of the 1985-86 Bulletir of 
Information under the heading "General Information," and on page 3 of the 
Institutional test program's Examinee Hanabook and Administration Form . 

For universities, colleges, and other institutions designated as 
TOEFL score recipients the required information appears on pp. 7-8 of the 
TOEFL Test and Score Manual . 

(b) Not applicable. TOEFL does not predict porforroance. 

(c) Required information appears on page 11 of the TOEFL Test and 
Score Manual under the heading "TOEFL Scores," and on ro, 20-23 of the 
Handbook for Examinees under the heading "Test Results/* 

(d) (1) Required information appears on pp. 14-18 of the TOEFL Test 
and Score Manual under heading "Using TOEFL Scores," however, TOEFL is not 
used to predict grade point average. 

(2) Required information appears on page 16 in the Bulletin of 
Information , under the blading "Preparing for and Taking the Test" for 
those applicants registering for the International/ Special Centt ^ lesting 
Projjram and on page 7 of the Examinee Handbook for the Institutional 
testing program test takers. 

(e) Required information on scoring procedures appears on page 14-15 
in the Internatioaal Lasting Program Bulletin of Informatio n and on pp. 
17-19 of the Institutional Examinee "'andbook. 
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(£) (I) Information on Quality Controls appears on page 18 of the 
Handbook for Examinees and on page 6 of the Institutional test program's 
Examinee Handboo ks 

(2) Required Information regarding the time period for reporting 
scores Is found on pp. 11-12 of the Bulletin of Information and Application 
Form , on page 20 of Handbook for Examinees , on page 16 of the Institutional 
program's Examinee Handbook and under the section of the Institutional Testing 
Program brochure titled "Summary of Institutional Testing Program Policies o" 

(3) Required Information appears on page 10 of the TOEFL Test 
and Score Manual under the heading "Confidentiality of Information," In 
the Handbook f or Examinees under the heading "Test Results," and In the 
Institutional Testing Program brochure under the heading "ETS Policy about 
Release of Individual Score Information." 

(g) Required Information appears In the B ulletin of Information on 
page 15, under the headln<^ "Score Reporting Services," and In the Examinee 
Handbook on page 16. 

(h) Required Information appears In the Ballet In of Information on 
page 15 under heading "Test Score Data.** 

(1) Required Information appears In the Bulletin of Information on 
page 14. 

(j) Required information filed under Paragraph 9II60. 

(k) Representative sample items appear in the Bulletin of Information , 
pp. 18-20, under the heading **Practice Questions," and in the Examinee 
Handbook , pp. 10-16. 

In addition, during 1985-86 TOEFL examinees and others had access to 
other test forms and related materials via the following program services: 

a. TOEFL Sample Test (equal to one-half the length of a TOEFL test 
form). Available to anyone at $3 per copy. 

b. Test materials from selected administrations. These include a 
copy of the test book and the cassette, the correc*: answers !:o the questions 
and a copy of the examinee's answer sheet with the raw scores marked. 
(Available to TOEFL examinees only who took the July, August, November and 
December 1985 and May 1986 administrations.) 

c. Understanding TOEFL . A complete test form with cassette for 
election 1, an answer sheet, and a workbook providing an explanation for 
each question and set of answrs. Available to applicants for $11 with 
the test fee or $13 on a separate order. 

d. Listening to TOEFL . Listening to TOEFL focuses on Section 1, the 
listening comprehension section of the test. It contains a workbook and 
three cassette recordings. Tne kit also contains two complete TOEFL tests, 
answer sheets ard lists of the correct answers for all of the questions. 
Available to applicants for $13 with the test fee. 
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99157. This section does not apply to the Test of English as a 
Foreign Language. 



99158. If the te3^ agency will be delayed In reporting a test 
subject* s score for a clme period amounting to 10 calendar days beyond the 
period specified In paragraph (2) of subdivision (f) of Section 99156, the 
test agency shall notify the test subject immediately. The notice shall 
Indicate the reasons for delay, lacludlng, but not limited to. Incorrect, 
Incomplete, or Inconsistent personal Identifying Information furnished by 
a test subject. 



99158. The Bulletin of Information , page 14, states that "test 
results will be sent ... one month after you take the test. Under no 
circumstances can they be sent any earlier. (Test results will be sent 
out two or three weeks later for examinees whose answer sheets arrive late 
at the TOEFL office or whose answer sheets are not completed properly.) 
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99159. The test agency shall establish a formal panel composed of 
test agency officials to review and decide cases of suspected t^st score.... 



ETS Test Security office provides for a formal panel composed of test 
agency officials and senior measurement staff who review and decide cases 
of suspected test score inauthenticity or irregularities. Brochures 
explaining the ETS test security procedures are sent to examinees whose 
scores are questioned (Samples included with report). 
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99160. (a) Whenever a test agency is presented with information 
which renders the test subject's test score suspect, whether that information 
is in the form of allegations callusion or cheating, or irregular test 
administration, or irregular statistical data, or any other form. The 
test agency shall submit the information to the review panel. The panel 
shall be responsible for reviewing the information and determining if an 
investigation is warranted. 



Information for examinees about the policy of cancelling TOEFL test 
scores is provided on pages 10, 11, and 15 of the 1985-86 Bulletin of- 
Information . If the test score is referred to the ETS Test Security 
office for validation and review by the formal panel, a letter and Test 
Security office brochure is sent to the examinee. Every opportunity is 
provided to the examinee to prepare a rebuttal. 



ERLC 



74 



83 



99161, (a) No test agency shall release or disclose any test score 
identifiable with any individual test suject, in any form whatso-^ver, to 
any test score recipient, unless the agency is specifically authorized hy 
the test subject to release that test score to the recipient. 



TOEFL Test and Score Manual describes to test score users the policy 

regarding Confidentiality of Information. (see page 10). Page 15 of 

the Bulletin of Information describes for the TOEFL examinees the TORFL 
policy regarding examinee score data. 



Graduate Record Examinations 
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Graduate Record Examinations Board 

PRINCETON NEW JERSEY 08541-6000 • AREA CODE 609 734-1105 



IN AFPillATKDN WITH 

Th« Associatton of Graduate Schools 

The Council of Graduate Schools 



1966 

Carolyn H Hargravt 
Louisiana Statt University 
Chairman 
• 

Jacqueline Adarr.s 
CBS News 

Richard K Barksdaie 
Universtty of Kansas 

James L Ctayton 
University of Utah 

Russell Q Har.itton 
Vanderbitt University 

Henry F Hcftzcfaw Jr 
Universtty ot Nebraska 

Kenneth L Moving 
University of Oktahoma 
Chairman*E)ect 

Jutes 6 Lapidus 
Council of Graduate Schoo's 

Robert B Lawson 
University of Vermont 

GeraidJ Lieberman 
Stanford University 

Jasper 0 Memory 
University of North Carolina System 

Shirley L Menaker 
University of Oregon 

Suzanne Reid 
western tMinOiS University 

T^rry T Saa*- o 
Northwest Area Foundation 

Mark B SchuPack 
Brown University 

Hanharan Swammathan 
University of Massachusetts Amherst 

Clarence L Ver Steeg 
Northwestern University 
Past Chairman 

Edward N Wiison 
Washington University 
• 

Charles W Oaves 
Secretary to the Board 



November 4, 1986 



Mr. Horace F. Crandall 
1020 Twelfth Street 
California Fostsecondary 
Education Commission 
Sacramento, CA 95814 

Dear Mr» Crandall: 

Forwarded herewith pursuant to the revised California 
Education Code, Senate Bill No, 1758, Chapter 1d05, Part 65 
Chapter 3, Sections 99152-9959 is information concerning 
administrations of the Graduate Record Examinations during the 
1985-86 testing year which ended on September 30, 1986. 

Enclosed are the following 1985-86 pul lications and reports 
referred to in this report: 

GRE Information Bulletin 1985-86 

Guide to the Use of the Graduate Record 

Examinations Program 1985-86 
Interpreting Your GRE General Test Scores 1985-86 
GRE General Test, Edition 86-1 (3 copies) 
GRE General Test, Edition 86-2 (3 copies) 
GRE General Test, Edition 86-3 (3 copies) 
GRE Technical Manual 

General Test, Test Analysis Forms 3GGR3, 3GGR4, 
3HGR2 

GRE/MGSLS Publications List and Order Form 
Order Form for the 1985-86 Information Bulletin 
Effects of Coaching on GRE Aptitude Test Scores, 
GREB #81-3R 

Report of students who have repeated the General 
Test and Subject Tests once, twice, or more than 
twice 
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Mr. Horace Crandall 



-2- 



November 4, 1986 



Descriptive booklets for all Subject Tests 
Sumnary of the Graduate Record Examinations 

Validity Study Service, June 1983 
Procedures for Questioned Scores 
Summary of Data Collected from Graduate Record 

Examinations Test Takers During 1984-85 (Data 

Summary Report #10) 



rhe Graduate Record Examinations Board has delegated to 
Educational Testing Service, Princeton, NJ 08541, the specific 
duty of publication and distribution of copies of these 
materials. 



cc: Mr. Robert A. Altman, Educational Testing Service 

Mr. Patrick M< Callan, Director 

Mr. Charles W. Daves, Educational Testing Service 

Mr. Stanford von Mayrhauser, Educational Testing Service 



Sincerely, 




Carolyn H. Har grave 
Chairman, GR£ Board 
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Graduate Record Examinations Program 
October 1, 1985 - September 30, 1986 



Report prepared for the Califcrnia 
Postsecondary Education Commission 



November 1986 
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GRADUATE RECORD EXAMINATIONS 

October I. 1985 - September 30. 1986 

Report prepared for 
California Postsecondary Education Conmission 
in compliance with 
Part 65 of the Education Code, Chapter 3, Section 99153 

99153. On or before November 15 of each year, the test sponsor shall 
submit to the Commission all of the following data and information: 

(a) ITirce copies of each version of the test which was disclosed in 
the pvior testing year, aloug with the corresponding acceptable answers, 
and the methods used to convert raw scores into the test scores reported 
to test subjects and test score recipients, together with an explanation 
of that method. 

(a) Attached to this report arc three versions of 

the GRE General Test vhich vere used In the most 
recent testing year, an axuwer key for each 
and explanation of th^ scoring of these tests. 
Also attached are copf of the test analysis 
reports for thc.ae test ^ ras. 



99153. (b) The dates of major or national administration of each tes^. 
administered by the test agency during the testing year. 

(b) Dates of the major administrations for the 
Graduate Kecord Examinations are Included 
In the calendar on the back cover of the enclosed 
GRE 1985-86 Information Bulletin and the 
Guide to the Use of the Graduate Record Examinations 
Program 1985-86. 



99153. (c) The total number of test subjects who have taken the test 
once, who have taken it twice, and who have taken it more than twice 
during the testing year. 



(c) The number of examinees who have taken the GRE tests 
once» tvlce, or more than twice is attached as a 
separate report. 
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99153. (d) The total number of test subjects who registered for, but 
did liOt take, the test. 



(d) The total nuaber of registrants ..or «aJor GRE 

adalnlatratlons of all General and Subject Tests in 
1985-86 was 311 ,257. Of these registrants, 46,308 did 
not take the tests* 

In California, there vera 28,680 registrants for all GRE 
General and Subject Tests. Of these, 3,31R did not take 
the testa. 



99153* (e) The total amounts of fees received from test subjects by 
the test agency for the test for that testing year. 



(e) Total fees received from test subjects (test takers) 
for the Graduate Record Examinations for 1985-86 
equalled $16,911,186. Ho record is available of the 
amount recexved from California test takers only; nor 
are records available for receipts by test title. The 
amount received represents four categories of income, 
as follotis: 



1. Registration fees paid by individual test 
subjects. 

2. Additional transcripts requested by Individual 
test subjects. 

3. Fees paid by institutions for institutional 
services. 

4. Program publications and services ordered by 
examinees. 



99153. (f) The expenses to the test sponsor of the test, as follows: 
(1) the expenses which are directly attributable to the test and (2) 
those expenses which are Indirectly attributable to the test. 



(f) (1.) Expenses directly attributable to the test and 

(2.) Expenses indirectly attributable to the test required 
by this section are as follovs: 
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Fees froB Test Takers for GR£ Tests $15»545»657 

Fees for Priced Publlcmtlons 963»804 

Fees for Institutional Services 401 » 725 

Total $16»91l,186 

General Sub j ec t 



Expenses Directly Attributable |10,666»569 14,257,235 



Test Administration 16,103,312 |2,034,4S? 

PrograB Direction 1 , 507 , 746 502 , 582 

Test Dereloiment 1,300,044 1,135,059 

Kesearch 502 , b^4 167 , 608 

Publications 1,252,643 417,548 

Expenses Indirectly Attributable $157,962 152,654 



Special Services 15,432 5,144 

GRE Board and Cowittees 142,530 47,510 

Expenses Hot Attributable 1577,638 



Graduate Program Self-Assesneut 165,733 

CGS/GRE Survey 5,161 

Graduate Prograas & Admissions Manual 203,771 

Minority Graduate Student Locator Service 131,264 

GRE/CGS Forums 68,235 

Technical Manual 3,474 



99153. (g) A copy of all documents, pamphlets, and literature provided 
to the test subject and the test score recipient. 

(g) (!•) Attached to this report are copies of each document, 
pamphlet, and literature provided to each test taker. 
These are: 

GRE Information Bulletin 1985-86 

Interpreting Yo ^ ir GRE General Test Scores 1985-86 

A sample Report of Scores (found on page 50 of the 
Guide) 
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(g) (2«) A copy of each document t pamphlet t and literature 

provided to each test score recipient are attached to 
this report. These are: 

Guide to the Use of the Graduate 
Record Examinations Program - 1985-86 

GRE 1985-86 Infonutlon Bulletin 

GRE/MCSLS Publications List and Order Form - 
1985-86 

Order Form for the 1985-86 Information Bulletin 
Gradate Record Examinations and Minority Graduate 
Student Locater Service 

Samples of score reportx ^ forms located on pages 
50-53 of the Guide 



99153 • (h) Where applicable, the national average test scores, state 
average test scores, the standard error of measurement, and any other 
existing information relevant to a comparison of the test scores of the 
state's test subjects with test scores of previous test subjects of the 
past five years* 



(h) GRE average scores are for the test-taking population 
reported on page 17 of the Guide to the Use of the 
Graduate Record Examinations Program 1985-86 . TSie standard 
error of measurement for Individual scores and score 
differences are reported on page 33. The results of all 
administrations of all forms or editions of a given test 
ar^ reported on the same scale. Rational and state average 
test scores are neither gathered nor reported. 



99153* (i) For those tests used to predict academic performance, the 
most rece. : national or regional aggregation of data concerning the 
predictive validicv of all of the following: 

(1) Academic record or grades alone. 

(2) Standardized test score alone* 

(3) Academic record and test score combined* 

(4) Standardized test £»cores over and above the predictive 
validity of academic record alone* 

(1) (1-4) Hie 1981-82 Sumary Report of the Graduate 

Record Examinations Validity Study Service is 
attached. 
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99153. (j) Using available data, the racial, ethnic, and sex breakdown 
of all test subjects taking each test during the testing year. 

(j) Kaclaly ethnic and sex Information Is self-reported by test 
takers and is not alvays provided to the GRE Prograa. 
Available ethnic data for GRE test takers are reported In 
the Guide to the Use of the Gradoate Record 
Eacamlnatlons Progran 1985-S69 Tables 6 and /, pages 27-28. 
Racial 9 ethnic and sex Infonaatlon Is reported In various 
tables throughout A Suaoary of Data Collected from 
Graduate Record Examinations Test Takers During 1984-85 
(Data Summary Report #10) April 1985, copy attaclsed. 



99153. (k) If a separate fee Is charged test subjects for admissions 
data assembly service, the test sponsor shall report information 
concerning the data assembly service in substantially the same form as 
would be required for a test under this section. 

(k) Not Applicable. 



99153. (1) This section shall not be construed to require any test 
agency to submit to the commission any reports or documents containing 
information relating to any individual test subject. Any information 
relating to any individual test subject. Any information relating to 
any individual test shall be deleted or obliterated from any reports or 
documents filed with the conmission pursuant to this section. 

(1) Information submitted In compliance with this section does 
not Include information Identifiable with any Individual or Institution. 
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GRADUATE RECORD EXAMINATIONS 

October 1, 1985 - September 30, 1986 

Report prepared for 
California Pcstsecondary Education Commission 
in compliance with 
Part 65 of the Education Code, Chapter 3, Section 99154 



99154. (a) Within 90 days of the close oc each testing year, the test 
sponsor shall file with the Commission standard technical data 
sufficient to describe the psychometric quality of the test. 



For purposes of compliance with this section, it is sufficient to 
deposit with the Commission information conforming to the guidelines 
specified in the Standards for Educi^tional and Psychological Tests of 
the American P?;ychological Association, which were in effect 180 days 
prior to the testing year, and which are appropriate to the particular 
test and its uses. 

(a) Tecfanlcal data describing the psychometric quality cf 
the tests are Included it the 
Guide to the Use of the GRE Proeram and the 
GRE Technical Manual. 



99154. (b) Data, repoics or other documents submitted pursuant to this 
chapter f^hall be accompanied by a description of the test, including, 
but not limited to, th^ itle, purpose or purposes of the test, and when 
and wb^re the test was administered in the state. 

(b) A description of the purposes of the tests and vfaen and 
vfaere they are administered in California is included in 
the GRE Inforvation Bulletin. 



99154. (c) Data, reports or other documents submitted pursuant to this 
chapter shall not contain information in a form identifiable with 
individuals or particular pofitsecondary educational institutions. 



(c) Information submitted with this section does not include data 
identifiable with any Individual or Institution. 
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GRADUATE RECORD EXAMINATIONS 

October 1, 1985 - September 30, 1986 

Report prepared for 
California Postsecondary Education Commission 
in compliance with 
Part 65 of the Education Code, Chapter 3, Section 99156 



99156. A test agency shall prepare a clear, easily understandable 
written description of each standardized test it administers. A copy of 
the appropriate description shall be provided to the test subject or the 
test score recipient together with the test registration "orms and 
related documents, prior to the administration of the test or coinciding 
with the initial reporting of a test score. The description shall 
include all of the following information: 

(•-'^ The purposes for which the test is constructed and intended 
to be usea. 

(a) The purposes for which the test are C(ni8tructed 
are described on page 5 of the 6RE Infonaation 
Bulletin. 



99156. (b) For those tests used to predict performance, the jubject 
matter included on these tests and the knowledge and skills which the 
test purports to measure. 

(b) The subject natter of and knowledge and skills 

measured by the GSE General Test and GRE Subject Tests Is 
described on page 5 of the GRE Information Bulletin. 



99156. (c) Statements designed to provide information for interpreting 
the test scores, including the explanations of the test, the standard 
error of measurement, and the correlation between test score and 
performance. 



(c) For Information to assist in Interpreting 

test scores, see the GRE Information Bulletin , 
^p. 25-30; student score leaflet. Interpreting Your 
GRE General Te t Scores 1985-86 r the Guide , pp. 10-13, 
32-34; the GRE Subject Test Description Booklets, p; 5, the 
GRE Technical Manual. 
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99156, (d) Statements concerning the effr^cts and uses of test scores, 
including the following: 

(1) If the test score is used by itself or with other 
information to predict future grade point average, a summary of existing 
data on the extent to which the use of this test score will improve the 
accuracy of predicting future grade point average, over and above all 
other informatior used. 

(d) (1) The 1981-82 Sunaary Report of the 

Graduate Record Examinations Validity Study 
Service are attached to this report. 

(2) A summary of existing data on the extent to which the 
improvement in test scores results from test preparation courses. 

(2) See attached GRE Board Report 81-3R, Effects 
of Coaching on GRE Aptitude Test Scores . 



99156. (e) A description of the form in which lest scores will be 
repor ed, and whether the raw test scores will be altered in any way 
before being reported to the test subject. 

(e) For the for« In Which test scores will be reported 
see the GRE Information Bulletin, p. 25-26. 



99156. (f) A complete description of any promises or covenants which 
the test agency makes to the test subject with regard to any of the 
following matters: 

(1) The accuracy of scoring. 

(1) For a description of the accuracy of scoring, see GRE 
Information Bulletin , p. 24. 

(2) The ti-e period within which the test subject's score will 
be reported to the test subject and to the test score 
recipients. 

(2) For the tla^e per lot within vfalch scores will be 
reported, see GRE I if oraatlon Bulletin , p. 25. 

(3) The privacy of information relating to the test subject, 
including his or her test scores. 

(3) For information about the privacy of inromatlon, 
see GRE Information Bulletin, p. 27. 
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99156. (g) The property interest in the test score held by the test 
subject, if any. 



(g) For information about property interest » 3ee 
GRE Inforaation Bulletin , p. 27. 



99156. (h) The period of time the test agency will retain the test 
score, and the test agency's policies regarding the storage, disposal, 
and future use of test scores. 



(h) For the retention of scores and use of scores, 
see GRE Information Bulletin p. 26-27. 



99156. (i) A description of all special ser^/ices which will be 
provided at the location of the test administration to accommodate 
handicapped or disabled test subjects. 



(1) For a description of handicapped services, 
see GRE Information Bulletin , pp.5, 8, 11, 12. 



99156. (j) The policies and procedures of the test agency when there 
is a delay in reporting the test scores pursuant to Sec Ion 91160. 

(j) For the policies concerning delay in score , 
see GRE Information Bulletin, p. 25. 



99156. (k) A representative set of sample test items. 

(k) For a sample General Test and sijuple questions, 
see pages 30-72, GRE Information Bulletin . For 
samples of the Subject Tests, see the descriptive 
booklets for each test. 
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99156. (1) The fees to be charged by the test sponsor for various 
services made available to the test subject. 



(1) For test fees, see GRE Information Bulletin , 
pp. I69 23, and 96. 



99ij6. (m) Each test agency shall comply with the requirements of this 
section beginning wltlt the start of Its testing year which begins after 
January 1, 1985. 
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GRADUATE RECORD EXAMINATIONS 

October 1, 1935 - September 30, 1986 

Report prepared for 
California Postsecondary Sducat' jn Commission 
in compliance with 
Part 65 of the Education Code, Chapter 3, Section 99157 & 99158 



9^157. This section does not apply to the Graduate Record Examinations 
Program. 



99158. (a) If the test agency will be delayed in reporting a test 
subject's score for a time period amounting ot IC calendar days beyond 
the period specified in paragraph (2) of subdivision (f) of Section 
99156, the test agency shall notify the test subject immediately. The 
notice shall indicate the reasons for delay, including, but not limited 
to, incorrect, incomplete, or inconsistent personal identifyi-"^ 
information furnished by a test subject. 

(a) The procedure for notifying test subjects and score 
users of any delay in submitting scores is described 
on page 23 of the 1985-86 GRE Information Bulletin^ 



90 



GRADUATE RECORD EXAMINATIONS 

October 1, 1985 - September 30, 1986 

Report prepared for 
California Postsecondary Education Commission 
In compliance with 
Part 65 of the Education Code, Chapter 3, Section 99159 



99159. (a) through (d) Whenever a test agency Is presented with 
Information which rena^rs the test subject's score suspect* • • • 

(a) through (I) Test takers* their parents » 
and others vfao advise them are entitled to 
know vfay certain scores have heen questioned 
and the procedures used hy Educational Testing 
Service (ETS) to verify or invalidate such 
scores. The pamphlet Intended to provide 
information to test takers ahout vfay their scores 
have heen questioned* Procedures for Questioned Scores » 
Is attached. 
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GRADUATE RECORD EXAMINATIONS 

October 1, 1985 - September 30, 1?86 

Report prepared for 
Callfoi.tila Postsecondary Education C^iamisslon 
In compliance with 
Part 65 of the Education Code, Chapter 3, Section 99160 



99V J (a) Whenever the test agency determines that substantial evidence 
exists to support cancelltition or Invalidation of a test score, the test 
agency shall provide the test subject with a choice of the following 
options: 

(1) A cancellation of the test scoree In question, with full refund 
of all test fees. 

(2) Opportunity to take the test again privately and without 
charge. 

(3) Opportunity to seek judicial review of the matter. 



(a) Infomatlon for test takers concerning the 

procedures used In cancelling questioned scores 
is found on page 25 of the GRE Infomatlon Bulletin 
and in the pamphlet. Procedures for 
Questioned Scores ♦ 



(b) The test subject shall have 30 days following receipt of the notice 
by registered mall to respond to the notice of Inauthentlclty . 

(b) ETS allows a mlnimm of 30 days for a te^t subject to 

respond follofving receipt of a registered (aail notice of 
inauthentlclty • 
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99160. (c) If the test subject responds to the notice of inauthenticity 
or irregularity of test ijcores sent by the test agency within the time 
period specified by subdivision (b) , the test agency shall review the 
contents of the response and comply 



(1) thrcugh (3) The procedures for each of these 
requlreMnts are described on p. 26 of the GRE 
Inforaatlop Bulletin and in the ETS pamphlet. 
Procedures for Questioned Scores > 



99160. (d) The test agency shall not release c^ nfidential 
information to any authorized test score recipients regrrding a test 
subject undir pending investigation, unless authorized to do so by the 
test subject. 



(d) Reviews of questionable scores by ETS 
are confidential; ETS does not release 
Inforaatlon about a questioned score to 
anyone unless authorized to do so by 
the test subject. 



99160 (e) The test agency shall immediately release the test score to 
the test subject and the test score recipients where no substantial 
evidence exists to render the inauthenticity or irregularity of the test 
score. 

(e) GRE scores held during investigation are released 

laaedlately upon a detenlnatlon that n^ substantial 
evidence exists to render the test score Inauthentlc 
or Irregular. 
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GRADUATE RLCORD EXAMINATIONS 

October 1, 1985 - September 30, 1986 

Report prepared for 
California Postsecondary Education Connnlsslon 
in compliance with 
Part 65 of the Education Code, Chapter 3, Section 99161 



99161. (a) No test agency shall release or disclose any test score 
identifiable with any individual test subject, in any form whatsoever, 
CO any test score recipient* unless the agency is specifically 
authorized by the test subject to release that test score to the 
recipient, A test agency may, however » release all scores re^^ived by 
test subject on a test to anyone designated by the test subject to 
receive the test score. 



(a) The confidentiality of GRE scores ia 

described for GRE score users on page 9 of 
the Guide to the Use of the GRE Prograa> 
Page 30 of the GRE Information Bulletin 
provide test takers vith information about 
GRE scores. 
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OATA on RtHhAre'<5 fO-' TOSR&b law (CAlXFUKMA) 
XAMlNCti TbSTEU etTWEhN 0CTUB6K 1, 1935 AND beKrbMBEK 30, 19bo 



TEST NAME ONCE [WlCE MUkE TmAN TWO 



GENERAL 


2t>2 ,9A6 


7,011 


^02 


6ICL0Gr 


12 ,297 


4h3 


lo 


CHEMlSTKr 


^ , 6^6 


135 


5 


COMPOTEk SCIENLtf 


6 , iCV 


1 VC 


16 


ecnN'GMics 


3 ,139 


0 ? 


2j 


bOuCATI ON 


3 ,?(.'> 






t(VGlN6ff K ING 


ti , 5 2V 


2 i 




FK ENCH 




t» 


0 


GCOlOGY 


2 ,2 59 


ICl 


8 


HibTURY 


2,361 


30 


2 


LITfcRArUr.t 


5 


12L 


2 


MATHEMATICS 


3,953 


9o 


2 


MUSIC 


1,6^2 


16 


1 


PHYSICS 


3,615 


255 


13 


POLITICAL SCIENCE 


2,092 


28 


0 


PSYCHOLOGY 


'13,o72 


278 


23 


SOCIOLOGY 


1,435 


29 


3 


SP AN I Sh 


518 


0 


0 
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Graduate Management Admission Test 
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Mctncioc iticfit 

Admission 

COUIKM 



November 10, 1986 



^fr• Horace Crandell 
California Post-Secondary 

Education Commission 
1020 12th Street 
Sacramento, California 95814 

Dear Mr* Crandell: 

On behalf of the Graduate Management Admission Council, the sponsor of 
the Graduate Management Admission Test, I am pleased to submit the 
Information required under Chapter 1505 of the laws of the state of 
California; Chapter 3, Part 65 of the Education Code, Sections 
99150-99164. 



Respectfully, 



...j^ 

William Broesamle 
President 



Board of Trustees 

^arnes W Scnmorter 
C^a^rrrian 
Ccrneti Un'verS't^ 

Mary Anne S Wlikart 
^/•ce Cna-rman 
University o? Ma-yiana 

Pacnei J Acler 
Washinr;:on University 

Oonald R Bell 
Umve-'Stty of Washington 

Maryann G Bilhngton 
Northeastern UniverSUv 

Waiter J Cao^p 
University cf Virginia 

^oger L Je-^Mn? 
Uo'verSiiy of Vepr^essee 



Floss M Stcize'^be'g 
V'Ce Presicent Pesearcn 

Lawrence W Hecht 
Secretary 



Enclosures : 

1) October 1985, January 1986, March 1986 and June 1986 
(MATS and Answer Keys (3 copies each) 

2) GMAT TECHNICAL REPORT 

3) GMAT 1985-86 BULLETIN OF INFORMATION 

4) GMAT CANDIDATE SCORE INTERPRETATION GUIDE 
:>) GUIDE TO THE USE OF (MAT SCORES 

6) PROCEDURES FOR QUESTIONED SCORES 
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Graduate Management Admission Couacil 



99153 

(a)(b) Enclosed are three (3) copies each of the actual Graduate Management 
Admission Tests administered on the regular national administration 
dates: 



October 19, 1985 
January 25, 1986 
March 16, 1986 
June 21, 1986 



Also included are scoring keys and explanatory materials. 

(c) During 1985-86, 200,427 individuals took the GMAT. The numbers of 
individuals who took it once, twice and more than twice during the 
year are not available. 

(d) During 1985-86, 40,013 individuals registered for but did not take the 
GMAT. 



Section 99153 - Financial information. Definitions are provided on 
the following page. 



(e) Total amount of fees received from test takers: 

1. GMAT Testing Program $ 8,678,700 

2. Guides to (MAT/MBA 807,200 

3. MBA Admission Forums $ 31,200 
Total income from test ikers $ 9,517,100 

(f)(1) Expenses directly attributable to the testing program: 

4. GMAT Test Administration $ 5,819,900 

5. GMAT Test Development ''6,300 

6. (MAT Validity Studies and Test Research $ 4^0,300 
Tor.al expenses directly attributable to the 

testing program $ 7,056,300 

(f)(2) Expenses indirectly attributable to the testing program: 

7. Institutional Programs and Council 

Administration $ 2,076,700 

8. Guides to OIAT/MBA 821,900 

9. MBA Admission Forums 193,000 
10. Other Publications and Programs for 

Prospective MBA Candidates $ 237,500 
Total expenses indirectly attributable to 

the testing program $ 3,329,100 

Total Council Expenses $10,385,400 
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Definitions of the financial information reported by the Graduate Management 
Admission Council pursuant to Section 99153. 



Line 1 Fees received from test takers for the testing program include fees 
for the test registration and basic score reporting service. Addition- 
al score reports may be purchased by candidates for an additional fee. 
Other service fees are for late registrations, supplementary test 
centers, foreign test center surcharges, test center changes, test 
disclosure materials, and hand rescoring services. 

Lines 2 Revenue and expense for the GUIDE TO MBA and the GUIDE TO GMAT is from 
and 8 sale and production of these two publications, respectively. The GUIDE 
TO MBA includes a section about graduate study in management, 
careers, and descriptions of more than 500 different MBA programs. The 
GUIDE TO (MAT contains three complete Graduate Management Admission 
Tests, with correct answers and explanations provided and a math 
review section. A software version of the GMAT Guij'e was developed 
dulling fiscal year 1985-86, to be sold beginning in fiscal 1986-87. 

Lines 3 Revenues from the MBA Admission Forums are received from students who 
and 9 attend these events, which gather representatives from the admissions 
offices of over 60 graduate schools of management in a single location 
to facilitate the exchange of information with prospective applicants 
and to • rovide an opportunity for students to ask questions about the 
(MAT. Expenses are incurred for planning and operating these programs. 
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Line 4 Expenses incurred for test administration include all expenses of test 
registration, test center administration, test related publications 
and mailings including test disclosure materials, computer scoring and 
reporting, statistical analysis, clerical responses to inquiries, and 
quality assurance. 

Lxne 5 Expenses for test development in 1985-86 include all expenses incurred 
for item writing, pretesting, and compilation of test forms, as well 
as statistical analysis for new test development. These are not the 
costs of the complete development of any one or more test forms, as 
the lead time to develop a test form is often 24 months. The test 
development costs incurred in any single year are for various phases 
of the development of several different forms. 

Line 6 Expenses are incurred for research concerning various aspects of the 
GMAT, development, storage, and reporting of technical data and 
candidate information about the testj, and research on the validity of 
the test performed for individual management schools. 

Line 7 Expenses included in this line are incurred for development and 
operation of admissions services for institutions which are broader 
than those projects included in //6 above. This item also includes 
expenses for the operations of the Graduate Management Admission 
Council which are necessary for it to maintain its active role in 
graduate management education , and responsibility or policy and 
direction of the testing program. It also includes expenses for 
education and professional development of admissions officers, che 
primary user's of the test. 

Line 10 Expenses are incurred for publications and programs provided without 
charge for prospective MBA candidates. These include publications 
concerning financial aid and information for international students, 
and programs to promote awareness of graduate management education 
among members of minority groups. 
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Enclosed are copies ox the GMAT BULLETIN OF INB'ORMATION, GMAT 
CANDIDATE SCORE INTERPRETATION GUIDE, end THE GUIDE TO THE USE OF 
GMAT SCORES. 



(h; 

(1) (l 

(2) (3 

(j; 

(k 

(i: 

99154 

(a: 

(b; 
(c: 

99156 

(a: 

(b 

(c: 

99156 

(d)(i; 
(2; 

(e; 

(f)(i: 
(2)(3: 

(g; 
(h; 

(i: 
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The mean GMAT scaled score appears in Table 2 of the CANDIDATE SCORC 
INTERPRETATION GUIDE. The standard error of measurement for the GMAT 
total score for recent forms is about 30; this information also 
appears with an explanation in the CANDIDATE GUIDE. 

The required information appears in the publication GMAT CANDIDATE 
SCORE INTERPRETATION GUIDE, distributed to all test subjects with 
their (4) score report. It also appears on page 11 of THE GUIDE TO 
THE USE OF GMAT SCORES, distributed to all institutional score 
recipients. 

This information is not available for the 1985-86 testing year. 

This section is not applicable. 

None of these data are individually identifiable. 



A copy of the GMAT TECHNICAL REPORT (copyright 1986) containing the 
required data is enclosed. 

A description of the test including title and purpose of the test, is 
contained in the QIAT 1985-86 BULLETIN OF INFORMATION for candidates, 
page 4. A schedule of locations and dates of test administrations 
appears on pages 28 of the BULLETIN. 



None of these data are individually identifiable. 



This information is contained in the BULLETIN on pages 4 and 16. 

This information appears on page 4 of the BULLETIN. 

The CANDIDATE SCORE INTERPRETATION GUIDE contains this information. 



This information is contained in the GtiAT CANDIDATE SCORE INTERPRETA- 
TION GUIDE and in THE GUIDE TO THE USE OF GMAT SCORES on page 11. 

The Graduate Management Admission Council is not aware of any 
existing data on this subject. This is stated in the BULLETIN on 
page 13. 

This description appears on pages 14 and 15 of the BULLETIN. 
These descriptions appear on pages 15 and 16 of the BULLETIN. 



This is described on page 15 of the BULLETIN 
This is described on page 15 of the BULLETIN 

Special services provided for handicapped or disabled t. st subjects 
are explained on pages 10 and 11 of the BULLETIN. 119 
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(j) The policies and procedures in these situations are described on page 
17 of the 30LLETIN. 

(k) A representative set of sample test items appear on pages 18, 19, 23 
and 24 of the BULLETIN. 

(I) Fees for various services are listed on i:he back cover of the 
BULLETIN. 
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(a)(b) Test disclosure services are described on page 14 of the BULLETIN. 

(c)(d) 

(e)(f) 



99158 Such a policy is in effect for the (MAT program. 
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(a)(b) The procedures followed are described in ETS PROCEDURES FOR QUESTIONED 

(c)(d) SCORES. 

and 

99160 

(a)(b) 

(c)(d) 

(e)(f) 

(g) 



99161 The GMAC policy in this regard is articulated on page 15 of the 
BULLETIN. 



IW/kag 

10/16/86 

lOA-76 
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T. SACLSA S 

Law School Admission Council/Law School Admission Services 



December 29, 1986 



Horace F. Crandell 

Postsecondary Education Administrator 
California Postsecondary Education Commission 
1020 Twelfth Sl 
Sacramento, CA 95814 

Subject: Law School Admission Council/Law School Admission Services 
Sponsor of the Law School Admission Test 



Dear Dr. Crandell: 

I submi t herewith material reflective of Law School Admission Council/Law School 
Admission Services' compliance with Chapter 3 of Part 65 of the Education Code of California (the 
Act), as it pertains to the Law School Admission Test, a standardized test as described in the Act 
These submissions comprise Law School Admission Council/Law School Admission Services* 
filing under Section 99153 of the Act 

Infornution required by Section 995 13 is reported below for the program year ending June 
30, 1986, with reference to applicable subsections of the Act 

Section 99153(a)* Three copies of each version of the test which was disclosed in the 
prior test year, along with the corresponding acceptable answers, and the methods used 
to convert raw scores into the test scores reported^to test subjects and test score recipients, 
together with an explanation of that method 

Section 99153(b). The dates of major or national administration of each test administered 
during the testing yean 

June 17, 1985 
October 5, 1985 
December?, 1985 
Febrniary 15, 1986. 

Section 99153(c). The total number of test subjects who have taken the test once: 81,810 
(9,215 of these have taken the test at least one previous time in a prior test year); 
who have taken the te^t twice: 8,999 ; and who have taken it more than twice: 327 
during the testing year. 

Section 99153(d). total number of test subjects who registered for, but did not take the 
test: 19,790. 

Section 99153(g). A copy of all documents, pamphlet^, and literature provided to the test 
subject and the test score recipient 

Q Box 40, Ncwtown» Pennsylvania 18940 j ^ 
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Tne 1985-1986 LSAT/LSDAS Registration Packet is distributed to all test candidates. 
Exhibits A andB from the 1985-1986 Registration Packets contain tiie information 
required at the following pages: 

a) The purpose for which the test ia, constructed and intended to be used. Page 2 of 
Exhibit A and page 6 of Exhibit B. 

b) The subject matters included on each test and the knowledge and skills that the test 
purports to measure. Pages 3 tiirough J 2 of Exhibit A and page 6 of Exhibit B. 

c) The manner in which the test is scored and the relationship of the raw and scaled 
scores to the skills and knowledge it measures. Page 2 of Exhibit A and pages 6,7 and 
16 of Exhibit B. 

d) The basis upon which such scores will be made available to persons or institutions. 
Pages 6-7 of Exhibit B. 

e) A representative set of sample test items. Pages 13-32 of Exhibit A. 

The Act requires that test subjects be provided with explanatory information to facilitate 
proper interpretation of test scores. Test subjects are provided with information on pages 
16-1" of Exhibit B that explains the meaning of scores including: Validity, Reliability, Stan- 
dara Error of Measurement, and Repeater Statistics. Information on these subjects also 
appears on the reverse of the test score report sent to each test subject In fulfillment of other 
obligations, designated institutions that are score recipients have also been provided with 
this information. They additionally wiU have received the US AC I LSAS Desk Book 
(Exhibit C is aa excerpt fiom the LSAC / LSAS Desk Book) before the first 
report of test scores in the current test year. A copy of relevant excerpts fix)m the current 
LSAC / TJSAS Desk Rook is included with this letter as Exhibit C in compliance with the 
provision that this information be provided to the Commission "prior to or coincident with 
the first reporting of test scoics to any test score recipient during a testing year." Test dates 
and locations at which the LSAT was administered in California in 1985- 1986 arc indicated 
at page 36 of Exhibit B (1985-1986 LSAS General Information Bo:klet) and Exhibit E 
(LSAT Test Centers for i:85-1986). The first test during the 1986-1987 testing year was 
given on June 16, 1986, with scores to be reported to test score recipients approximately 
four weeks later. 

Test score recipients are provided with standard technical data sufficient to describe the 
psychometric quality of the test These are provided in the sources rcferred to below. 
Exhibit C contains excerpts from the LSAC / LSAS Desk Book, a manual 
for users of the Law School Admission Test Topics covered include: what the tssi 
measures (pg.ll), test scoring (pg. 13), test reporting (pp.13- 15), validity (pp. 17-18), 
standard error of measurement and reliability (pp. 18-20), statistical data for the LSAT - 
National (pg. 20), and avoiding misuse of the scores (pp. 23-24). 

Section 99153(h). Where applicable, the national average test score: 30 ; the state avenge 
test score: 32 . (Average LSAT scores were calculated only for those individuals whose 
undergraduate transcripts had been received and summarized by the Law School Data 
Assembly Service or I5DAS, and who had a reportable LSAT score on file.) hiformation 
on the standard error of measurement, and any other existing information relevant to a 
comparison of the test scores of the state's test subject with test scores of previous test 
subjects of the past five years can be found under 99153(g). 
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Section 99l53(i). For those tests used to predict academic performznce, the most recent 
national or regional aggregation of data concerning the predictive validity of all of the 
following: 

1. Academic record or grades alone. 

2. Standardized test score alone. 

3. Academic record and test score combined. 

4. Standardized test scores over and above the predictive validity of academic 
record alone. 

Tiie published reference set entided Law School Admission Resear ch includes this infonna- 
tion in the study designated LSAC 76-78; W.B. Schrader, Summary of Law School VaUdity 
Studies, 1948-75, Vol. HI p. 519, which was filed with the Commission in September 
1979. Volume IV of Law School Admission Research , which was filed with the 
Conmiissi<m in December, 1985, includes the most recent data concerning jpredictive 
validity in the studies designated LSAT-82-1, F.R. Evans, Recent Trends m Law 
School Validity Studies, p. 347, and LSAC-83-1, RX. Linn and CJ^. Hastings, A 
Meta-Analysis of tfie Validity of Predictors of Performance in Law School. These studies 
have been distributed to institutions that are test score recipients as required. Over the years, 
the majority of law schools have participated in statistical studies that compared students' 
LSAT scores with their first-year grades in law school. Although the correlations between 
test scores and grades are not perfect, these studies show that LSAT scores help to predict 
which students will do well in law school Moreover, a combination of students' scores and 
undergraduate grade averages gives a better prediction than either factor considered alone. 
Traditional validity studies concerning the edition of the Law School Admissicm Test first 
introduced in June 1982 have not as yet been carried out However, LSAC/LSAS has, for 
the past two years, conducted preliminao' coirel^on studies for those law schools interested 
in the preliminary predictive potential of the revised LSAT. As is the case with undeigrad- 
uatc grade averages, the conelati<Mi between LSAT scores and first-year law school grades 
varies from one law school to another. During 1985, preliminary correlation studies were 
conducted for 134 of the 175 LSAC-member schools. Correlations between LSAT scores 
and first-year law school grades ranged from .19 to .66. Correlations between LSAT scores 
combined with undergraduate grade averages and first-year law school grades ranged from 



Section 99153(j). Using available data, the racial, ethnic, and sex breakdown of all test 
subjects taking the test during the testing yean 



Male 49,086 

Female 32,724 

American Indian 518 

Black/Afro- American 6,791 

Caucasian/White 73,441 

Chicano/Mexican- American 1,342 

Hispanic 2,064 
Asian- American/Pacific Islander 2, 1 65 

Puerto Rican 1,166 

Other 435 



In the 1985-1986 testing year, ending June 30, 1986, 88,834 persons registered for the 
LSDAS. 
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To meet the requirement of Section 99153(e),(f) and (k), I am enclosing a copy of the 
1985-1986 audited financial report for LSAC/LSAS along with detailed information on the 
fee schedule in use during that fiscal year (Exhibits E and F). as you will note, LSAO 
LSAS provides comprehensive admission services to law school applicants and to law 
schools; thus, allocations of revenue to discrete services would not provide an accurate 
picture of the relationship of fees to services. We feel that the audited financial report 
will afford you a greatrr familiarity with the financial posture of LSAC/LSAS than would be 
possible by artificially disaggregating financial data and allocating it to specific services. 

Please feel free to contact me if I can jrovide you with further information. 




Enclosures 



cc: Thomas O. White 
Bruce I. Zimmer 
Ren6e Owens Kennish 
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EXHBITS AND ENCLOSURES 



Exhibit A - 1985-1986 Law School Admission Test: Law School Admission Services 
Preparation Material / Sample Test 

Exhibit B - 1985-1986 LSAS General Information Booklet 

Exhibit C - Exceipt from 1985 LSAC / LSAS Desk Book 

Exhibit D - LSAT Test Centens for 1985-1986 

Exhibit E - LSAC/LSAS Inc. Combined Statement of Revenues and Expenses and Changes 
in Fund Balance 

Exhibit F - Fee Schedule 1985-1986 General Information Booklet, page 9 

Enclosures 1) Disclosed test (3 copies) and answer keys 
June 17, 1985 
Octobers, 1985 
December 7, 1985 
February 15, 1986 

2) 1985-1986 Law School Admission Test: Law School Admission Services 
Preparation Material / Sample Test 

3) Exceipts from 1985 LSAC / LSAS Desk Book 

4) LSAT Test Centers for 1985-1986 

5) LSAC/LSAS Inc. Combined Statement of Revenues and Expenses and 
Changes in Fund Balance 

6) Fee Schedule 1985-1986 
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EXHIBIT E 



LAW SCHOOL ADMISSION SERVICES, INC* AND 
LAW SCHOOL ADMISSION COUNCIL, INC* 

Combined Statement of Revenues end Expenses 
end Changes In Fund Belence 



Yeer Ended 
June 30 



Revenues 

Admission service fees 
Publlcetlon programs 
Student loan program 
Conference fees 
Dati outputs and reports 
Interest income 
Miscellaneous income 

Total revenues 

Expenses 

Personnel costs ^ 
Professional services 
Lav school education programs 
Physical plant costs 

Equipment, supplies, materials and maintenance 
Coroiunications and shipping 
General business expenses 

Total expenses 

Excess of revenues over expenses 
Fund balance, beginning of year 
Fund baL'^nce, end of year 



1986 


1985 


$10,523,379 


$10,713,355 


380,888 


198,395 


339,003 


129,450 


:^4,067 


106,935 






751,556 


727,887 


o,OxJ 


3,048 


12,252,800 


11,879,070 


3,563,406 


3,499,465 


1,679,144 


1,271,200 


474,468 


626,620 


666,503 


742,919 


2,904,190 


3,092,944 


877,713 


752,258 


662,187 


726,012 


10,827,611 


10,711,418 


1,425,189 


1,167,652 


7,650,551 


6,482,899 


$ 9,075.740 


$ 7,650,551 



FRir 
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association of amerioan 
medical colleges 



December 18, 1986 



Horace Crandall 

California Postsecondary Education Commission 

Second Floor 

1020 Twelfth Street 

Sacramento, California 95814 

Dear Mr» Crandall : 

The information contained herein is submitted in response to the requirements of 
Sections 99153 through 99155 of the California Education Code concerning the Med- 
ical College Admission Test (MCAT). 

The summary of income and expenses for the MCAT and the American Medical College 
Application Service (AMCAS) as reouired by the Code is delineated on the attached 
statement* The following data on the MCAT are reported for the July 1, 1985 to 
June 30, 1986 test year: 

Total number of tests administered: 40,881 

Total number of individuals taking the MCAT 

once during the test year: 37,877 

Total number of individuals taking the MCAT 

twice during the test year: 1,502 

Total number of individuals who registered 

but did not take the test for wnich they registered: 7,176 

Since the test is given only twice during the tez \ ye'^r, this also represents the 
maximum number of times an individual can sit for the test. The MCAT fee was $55.00 
for the Fall 1985 administration and $65.00 for the Spring 1986 administration. It 
is important to note that individuals who register for a specific test administration 
and subsequently do not sit for that test are provided the opportunity to register 
for the following test administration for a fee of $10.00. The remainder of the pre- 
viously submitted registration fee is credited toward the individual's second registra- 
tion. 

The distributions of MCAT scores for examinees who declared California as their legal 
state of residrnce for the two reported administrations are enclosed. The two en- 
closures entitled "Table V* represent the distribution of MCAT scores for all exami- 
nees who sat for the same administrations. 

Two recent studies, "Vital Statistics on the Medical College Admission Test," and 
"Factor Structure of the MCAT and Pilot Essay," are included for your information. 
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Horace Crandall 
December 18, 1986 
Page Two 



The document entitled, "Explanation of Scores for Examinees," accompanies all score 
reports to examinees to assist in the interpretation of their score performance. 

If you have any questions concerning any of the enclosed information, please feel 
free to contact me. 



Sincerely yours. 





{J James Erdmann, Ph.D. 



Director 



Division of Educational 



Measurement and Research 



JBErgcc 
Enclosures 
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statement of Income and Expenses for 
Medical College Admission Test (MCAT) 
American Medical College Application Service (AMCAS) 
July 1, 1985 to June 30, 1986 



tiXPENSES 

A* Directly Attributable to the Test 

1 ) MCAT Research and Development 

Continued development of test items 
and forms and research concerned with 
test interpretation 

2) Operations 

Activities associated with national 
test administration ard score re- 
porting 

3} Interpretive Services and Information 
Dissemination 

Provision of materials, reports, and 
consultation regarding MCAT inter- 
pr'^tation and performance 

4) Reserve for Future Redesign 

5) Special Legal Services 

Indirectly Attributable to the Test 

1 ) Overhead 

70*0% on salaries of AAMC personnel 
only calculated at federally audited 
rate 

C. Data Assembly Services 

1) AMCAS Reporting 

Organization, validation, and 
dissemination of application 
materials, including MCAT scores 



MCAT 



386,273 



AMCAS 



1,509,253 



351 ,964 



166,315 
82,725 

128,326 



-0- 



•0- 



33,685 
-0- 

631 ,025 



2,166,236 
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Page Two 



2) AMCAS Development 

TOTAL EXPENSES 

INCOME 

MCAT Testing Fees 

Additional MCAT Score Report Fees 

AMCAS Fees 

TOTAL INCOME 

Income over Expenses 



MCAT 
-0- 

2,624,856 



2,673,991 
191,603 
-0- 

2,865,594 
240,738 



AMCAS 
24,920 
2.855,866 



-0- 
-0- 

4,044,074 
4,044,074 
1 ,188,208 
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CALIFORNIA POSTSECONDARY EDUCATION COMMISSION 



^ THE California Postsecondary Education Commis- 

sion is a citizen board established in 1974 by the Leg- 
islature and Governor to coordinate the efforts of 

^ California's colleges and universities and to provide 

independent, non-partisan policy analysis and recom- 
mendation£ to the Governor and Legislature. 

Members of the Commission 

The Commission consists of 15 members. Nine repre- 
sent the general public, with three each appointed for 
six-yeair terms by the Governor, the Senate Rules 
Committee, and the Speaker of the Assembly. The 
other six represent the major segments of postsecond- 
ary education in California. 

As of March 1987, the Commissioners representing 
the general public are: 

Seth P. Bninner, Sacramento 

C. Thomas Dean, Long Beach, Chairperson 

Seymour M. Parber, M.D., San Francisco 

Cruz Reyiioso, Los Angeles 

Lowell J. Paige, El Macero 

Roger C. Pettitt, Los Angeles 

Sharon N, Skog, Mountain Viev. , Vice Chairperton 

Thomas E. Stang, Los Angeles 

Stephen P. Teale, M.D., Mokelumne Hill 

Representatives of the segments are. 

Yori Wada, San Francisco; representing the Regents 
of the University of California 

Claudia H. Hampton, Los Angeles; representing the 
Trustees of the California State University 

Arthur H, Margosian, Fresno; representing the 
Board of Governors of the California Community Col- 
leges 

Donald A. Henricksen, San Marino; representing 
California's independent colleges and universities 

Harry Wugalter, Thousand Oaks; representing the 
Council for Private Postsecondary Educational Insti- 
tutions 

Angie Papadakis, Palos Verdes; representing the 
California State Board of Education 
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Functions of the Commission 

The Commission is charged by the Legislature and 
Governor to ''assure the effective utilization of public 
postsecondary education resources, thereby eliminat- 
ing waste and unnecessary duplication, and to pro- 
mote diversity, innovation, and responsiveness to 
student and societal needs." 

To this end, the Commission conducts independent 
reviews of matters affecting the 2,600 institutions of 
postsecondary education in California, including 
Community Colleges, four-year colleges, universi- 
ties, and professional and occupational schools. 

As an advisory planning and coordinating body, the 
Commission does not administer or govern any insti- 
tutions, nor does it approve, authorize, or accredit 
any of them. Instead, it cooperates with other state 
agencies and non-governmental groups that px. 4brm 
these functions, while operating as an independent 
board with its own staff and its own specific duties of 
evaluation, coordination, and planning. 

Operation of the Commission 

The Commission holds regular meetings throughout 
the year at which it debates and takes action on staff 
studies and takes positions on proposed legislation 
affecting education beyond the high school in Cali- 
fornia. By law, the Commission's meetings are open 
to the public. Requests to address the Commission 
may be made by writing the Commission in advance 
or by submittin«T a request prior to the start of a meet- 
ing. 

The Commission s day-to-day work is carried out by 
its staff in Sacramento, under the guidance of its ex- 
ecutive director, William H. Pickens, who is appoint- 
ed by the Commission. 

The Commission issues some 30 to 40 reports each 
year on major issues confronting California postsec- 
ondary education. Re;-ent reports are listed on the 
back cover. 

Further information about the Commission, its meet- 
ings, its staff, and its publications may be obtained 
from the Commission offices at 1020 Twelfth Street, 
Third Floor, Sacramento, CA 98514-3985; telephone 
(916) 445-7933. 
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California Postsecondary Education Commission Report 87-13 



ONE of a series of reports published by the Commis- 
sion as part of its planning and coordinating respon- 
sibilities. Additional copies may be obtained without 
charge from the Publications Office, California Post- 
secondary Education Commission, Third Floor, 1020 
Twelfth Street, Sacramento, California 98514-3985. 

Recent reports of the Commission include: 

87-2 Women and Minorities in California Public 
Postsecondary Education: Their Employment, Class- 
ification, and Compensation, 1975-1985. The Fourth 
in the Commission's Series of Biennial Reports on 
Equal Employment Opportunities in California's 
Public Colleges and Universities (February 1987) 

87-3 Issues Related to Funding of Research at the 
University of California: A Report to the Legislature 
in Elesponse to Supplemental Language in *-he 1985 
Budget Act (February 1987) 

87-4 The California State Univers^'^y's South 
Orange County Satellile Center: A Report to the 
Governor and Legislature in Response to a Request 
from the California State University for Funds to 
Operate an Off-Campus Center in Irvine (February 
1987) 

87-5 Proposed Construction of San Diego State Uni- 
versity's North County Center: A Report to the Gov- 
ernor and Legislature in Response to a Request for 
Capital, Funds from the California State University 
to Build a Permanent Off-Campus Canter of San Di- 
ego State University in San Marcos (February 1987) 

87-6 Interim Evaluation of the California Student 
Opportunity and Access Program (Cal-SOAP): A Re- 
port with Recommendations to the California Stu- 
dent Aid Commission (February 1987) 

87-7 Conversations About Financial Aid. State- 
meats and Discussion at a Commission Symposium 
on Major Issues and Trends in Postsecondary 
Student Aid (February 1987) 

87-8 California Postsecondary Education Commis- 
sion News, Number 2 [The second issue of the Com- 
mission's periodic newsletter] (February 1987) 

87-9 L;xpi?nding Educational Equity in California's 



Schools and Colleges: A Review of Existing and Pro- 
posed Programs, 1986-87. A Report to the California 
Postsecondary Education Commission by Juan C. 
Gonzalez and Sylvia Hurtado of thv Higher Educa- 
tion Research Institute, UCLA, January 20, 1987 (Feb- 
ruary 1987) 

87-10 Overview of the 1987-88 Governors Budget 
for Postsecondary Education in California, ^resented 
to the Senate Budget and Fiscal Review Subcommit- 
tee #1 by William H. Pickens, Executive Director, 
California Postsecondary Education Commission 
(March 1987) 

87- 1 1 The Doctorato in Education. Issues of Supply 
and Demand in California (87) 

87-12 Student Public Service and the "Human 
Corps": A Report to the Legislature in Response tc 
Assembly Concurrent Resolution li . (Chapter 165 of 
the Statutes of 1986) (March 1987) 

87-14 Time Required to Earn the Bachelors De- 
gree: A Commission Review of Studies by the Califor- 
nia State University and the University of California 
in Response to Senate Bill 2066 (1986) (March 1987) 

87-15 Comments on the Repor* '*>f the California 
State University Regarding the Potential Effects of 
Its 1988 Course Requirements A Report to the Leg- 
islature in Response to Assembly Concurrent Resolu- 
tion 158 (Chapter 165 of the Statutes of 1986) (March 
1987) 

87-16 Changes in California State Oversight of Pri- 
vate Postsecondary Education Institutions: A Staff 
Report to the California Postsecondary Education 
Commission (March 1987) 

87-17 Faculty Salaries in California's Public L"n'- 
versities, 1987-88: The Commission s 19^6 Report to 
the Legislature and Governor in Re. .onse to St'nate 
Concurrent Resolution No. 51 (1965i iMaich 19S7) 

87-18 Funding Excellence in California Higher Ed- 
ucation: A Report in Response to Assembly Concur- 
rent Resolution 141 (1986) (March 1987; 

87-19 The Class of *83 One Year Later- A Report on 
Follow-Up Surveys from the Commission's 1983 
High School Eligibility Study iG/87) 
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